Sep 19 15:12:16.729525 ip-10-0-132-152 systemd[1]: Starting Kubernetes Kubelet...
Sep 19 15:12:17.151066 ip-10-0-132-152 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 15:12:17.151066 ip-10-0-132-152 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 19 15:12:17.151066 ip-10-0-132-152 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 15:12:17.151066 ip-10-0-132-152 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 19 15:12:17.151066 ip-10-0-132-152 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 15:12:17.152167 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.152090    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 19 15:12:17.156047 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156027    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 15:12:17.156047 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156044    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 15:12:17.156047 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156048    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156064    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156069    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156073    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156076    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156080    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156084    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156088    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156092    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156095    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156099    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156104    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156108    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156111    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156116    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156119    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156123    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156127    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156131    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156136    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 15:12:17.156265 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156140    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156144    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156147    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156151    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156155    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156159    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156163    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156167    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156171    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156175    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156179    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156183    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156187    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156210    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156216    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156221    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156225    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156229    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156232    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156236    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 15:12:17.157063 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156241    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156247    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156253    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156261    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156266    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156270    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156275    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156281    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156285    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156298    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156302    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156307    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156311    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156316    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156320    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156324    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156328    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156332    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156338    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 15:12:17.157849 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156344    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156349    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156353    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156357    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156361    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156365    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156370    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156374    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156380    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156384    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156388    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156392    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156396    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156400    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156405    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156409    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156413    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156418    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156423    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156427    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 15:12:17.158622 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156431    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156435    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156439    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156443    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156448    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156452    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156456    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156460    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156464    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156468    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156472    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156476    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156480    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156484    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156488    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156492    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156496    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.156500    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158792    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158805    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 15:12:17.159486 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158810    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158815    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158820    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158825    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158830    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158835    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158839    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158844    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158849    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158853    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158857    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158861    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158865    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158869    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158874    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158879    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158883    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158887    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158891    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158895    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 15:12:17.160365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158900    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158904    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158908    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158912    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158918    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158922    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158926    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158930    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158934    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158938    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158944    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158950    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158957    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158961    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158965    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158970    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158974    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158978    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158983    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158988    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 15:12:17.161321 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158992    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.158996    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159000    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159006    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159012    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159017    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159021    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159026    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159031    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159037    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159041    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159045    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159049    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159053    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159057    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159061    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159065    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159069    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159074    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 15:12:17.162076 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159078    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159081    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159085    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159089    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159093    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159097    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159101    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159106    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159110    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159114    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159119    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159123    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159127    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159131    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159137    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159141    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159145    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159149    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159153    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159157    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 15:12:17.162560 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159162    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159166    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159170    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159175    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159179    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159183    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159187    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159210    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159215    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159219    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159223    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159227    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159231    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159237    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159244    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159248    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159253    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159258    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159855    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 15:12:17.163129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159864    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159870    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159874    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159880    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159884    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159888    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159893    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159897    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159901    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159905    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159909    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159913    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159918    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159923    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159927    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159932    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159936    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159941    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159945    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159949    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 15:12:17.163653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159953    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159957    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159962    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159966    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159970    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159975    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159979    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159983    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159987    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159991    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159995    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.159999    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160003    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160007    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160011    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160016    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160021    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160032    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160036    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 15:12:17.164130 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160040    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160044    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160048    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160053    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160057    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160061    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160066    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160073    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160078    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160083    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160087    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160091    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160095    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160099    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160103    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160107    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160111    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160115    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160119    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160123    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 15:12:17.164826 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160127    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160131    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160135    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160139    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160143    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160148    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160154    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160160    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160164    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160168    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160172    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160176    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160180    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160184    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160214    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160219    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160225    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160229    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160232    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 15:12:17.165427 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160236    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160241    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160244    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160250    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160253    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160258    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160262    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160266    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160270    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160274    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160278    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160282    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160293    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160298    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160302    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160309    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160315    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160319    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160323    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 15:12:17.165976 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.160328    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160423    2562 flags.go:64] FLAG: --address="0.0.0.0"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160472    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160482    2562 flags.go:64] FLAG: --anonymous-auth="true"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160490    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160496    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160501    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160507    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160514    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160519    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160523    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160529    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160534    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160539    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160543    2562 flags.go:64] FLAG: --cgroup-root=""
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160548    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160552    2562 flags.go:64] FLAG: --client-ca-file=""
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160557    2562 flags.go:64] FLAG: --cloud-provider="external"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160562    2562 flags.go:64] FLAG: --cluster-dns="[]"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160568    2562 flags.go:64] FLAG: --cluster-domain=""
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160572    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160577    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160582    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160587    2562 flags.go:64] FLAG: --container-log-max-files="5"
Sep 19 15:12:17.166461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160593    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160597    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160602    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160607    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160613    2562 flags.go:64] FLAG: --contention-profiling="false"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160618    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160623    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160628    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160632    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160638    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160643    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160648    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160652    2562 flags.go:64] FLAG: --enable-load-reader="false"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160657    2562 flags.go:64] FLAG: --enable-server="true"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160661    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160668    2562 flags.go:64] FLAG: --event-burst="100"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160674    2562 flags.go:64] FLAG: --event-qps="50"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160679    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160683    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160688    2562 flags.go:64] FLAG: --eviction-hard=""
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160694    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160699    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160704    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160708    2562 flags.go:64] FLAG: --eviction-soft=""
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160713    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 19 15:12:17.167064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160717    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160724    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160729    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160733    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160738    2562 flags.go:64] FLAG: --fail-swap-on="true"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160742    2562 flags.go:64] FLAG: --feature-gates=""
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160748    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160753    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160758    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160763    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160767    2562 flags.go:64] FLAG: --healthz-port="10248"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160772    2562 flags.go:64] FLAG: --help="false"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160777    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160782    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160787    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160791    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160797    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160803    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160807    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160812    2562 flags.go:64] FLAG: --image-service-endpoint=""
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160817    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160821    2562 flags.go:64] FLAG: --kube-api-burst="100"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160826    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160831    2562 flags.go:64] FLAG: --kube-api-qps="50"
Sep 19 15:12:17.167697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160836    2562 flags.go:64] FLAG: --kube-reserved=""
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160840    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160845    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160850    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160855    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160859    2562 flags.go:64] FLAG: --lock-file=""
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160864    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160868    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160873    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160882    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160887    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160891    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160896    2562 flags.go:64] FLAG: --logging-format="text"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160900    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160905    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160910    2562 flags.go:64] FLAG: --manifest-url=""
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160914    2562 flags.go:64] FLAG: --manifest-url-header=""
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160921    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160925    2562 flags.go:64] FLAG: --max-open-files="1000000"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160931    2562 flags.go:64] FLAG: --max-pods="110"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160936    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160941    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160964    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160971    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160977    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 19 15:12:17.168353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160982    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160986    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.160998    2562 flags.go:64] FLAG: --node-status-max-images="50"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161003    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161008    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161012    2562 flags.go:64] FLAG: --pod-cidr=""
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161017    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161025    2562 flags.go:64] FLAG: --pod-manifest-path=""
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161029    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161034    2562 flags.go:64] FLAG: --pods-per-core="0"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161039    2562 flags.go:64] FLAG: --port="10250"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161044    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161049    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-053f817cbda43b6ba"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161054    2562 flags.go:64] FLAG: --qos-reserved=""
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161058    2562 flags.go:64] FLAG: --read-only-port="10255"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161063    2562 flags.go:64] FLAG: --register-node="true"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161067    2562 flags.go:64] FLAG: --register-with-taints=""
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161076    2562 flags.go:64] FLAG: --registry-burst="10"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161082    2562 flags.go:64] FLAG: --registry-qps="5"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161087    2562 flags.go:64] FLAG: --reserved-cpus=""
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161092    2562 flags.go:64] FLAG: --reserved-memory=""
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161098    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161102    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161107    2562 flags.go:64] FLAG: --rotate-certificates="false"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161112    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 19 15:12:17.169017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161116    2562 flags.go:64] FLAG: --runonce="false"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161120    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161125    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161130    2562 flags.go:64] FLAG: --seccomp-default="false"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161135    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161139    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161144    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161148    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161153    2562 flags.go:64] FLAG: --storage-driver-password="root"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161158    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161162    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161167    2562 flags.go:64] FLAG: --storage-driver-user="root"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161171    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161175    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161181    2562 flags.go:64] FLAG: --system-cgroups=""
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161186    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161214    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161218    2562 flags.go:64] FLAG: --tls-cert-file=""
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161223    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161229    2562 flags.go:64] FLAG: --tls-min-version=""
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161234    2562 flags.go:64] FLAG: --tls-private-key-file=""
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161238    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161243    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161248    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161254    2562 flags.go:64] FLAG: --v="2"
Sep 19 15:12:17.169657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161261    2562 flags.go:64] FLAG: --version="false"
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161268    2562 flags.go:64] FLAG: --vmodule=""
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161273    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.161278    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161461    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161470    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161476    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161481    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161486    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161490    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161495    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161500    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161504    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161509    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161514    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161521    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161527    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161531    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161536    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 15:12:17.170323 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161541    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161546    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161552    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161557    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161562    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161566    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161570    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161574    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161578    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161582    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161586    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161590    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161597    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161601    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161605    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161610    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161614    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161619    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161623    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161627    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 15:12:17.170785 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161631    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161635    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161639    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161643    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161647    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161651    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161655    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161659    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161663    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161667    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161671    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161675    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161679    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161684    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161689    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161693    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161697    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161703    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161708    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161712    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 15:12:17.171300 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161716    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161721    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161724    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161729    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161734    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161738    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161742    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161746    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161751    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161755    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161759    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161763    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161767    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161771    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161775    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161779    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161784    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161788    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161792    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161796    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 15:12:17.171779 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161800    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161803    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161808    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161812    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161816    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161819    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161825    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161829    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161833    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161837    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161841    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161845    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161849    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161853    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161857    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161862    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161867    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161871    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161875    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161879    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 15:12:17.172284 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161883    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 15:12:17.172778 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161887    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 15:12:17.172778 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161892    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 15:12:17.172778 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.161896    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 15:12:17.172778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.162838    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 15:12:17.172778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.170377    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 19 15:12:17.172778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.170392    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 19 15:12:17.172778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.170405    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 19 15:12:17.172778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.170411    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 19 15:12:17.172778 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170474    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 15:12:17.172778 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170478    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 15:12:17.172778 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170482    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 15:12:17.172778 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170486    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 15:12:17.172778 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170490    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 15:12:17.172778 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170493    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170496    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170499    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170501    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170504    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170507    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170509    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170512    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170515    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170517    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170519    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170522    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170524    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170527    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170529    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170532    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170535    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170537    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170540    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170542    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 15:12:17.173128 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170545    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170547    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170550    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170553    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170556    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170559    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170562    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170564    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170567    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170570    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170573    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170575    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170578    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170580    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170583    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170585    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170588    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170591    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170593    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170596    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 15:12:17.173725 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170598    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170601    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170603    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170606    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170609    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170611    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170613    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170617    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170619    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170622    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170625    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170627    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170630    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170632    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170635    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170637    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170641    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170643    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170646    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170649    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 15:12:17.174255 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170651    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170654    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170656    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170659    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170661    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170664    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170666    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170669    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170671    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170674    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170676    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170678    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170681    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170683    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170686    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170688    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170692    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170696    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170699    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 15:12:17.174737 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170702    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 15:12:17.175205 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170704    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 15:12:17.175205 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170707    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 15:12:17.175205 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170710    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 15:12:17.175205 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170712    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 15:12:17.175205 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170714    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 15:12:17.175205 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170717    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 15:12:17.175205 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170719    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 15:12:17.175205 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170721    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 15:12:17.175205 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170724    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 15:12:17.175205 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170727    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 15:12:17.175205 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170730    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 15:12:17.175205 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170732    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 15:12:17.175205 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170735    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 15:12:17.175205 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170738    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 15:12:17.175205 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.170743    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170853    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170858    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170861    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170864    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170866    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170869    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170871    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170874    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170876    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170879    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170882    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170884    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170887    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170889    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170892    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170894    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170897    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170900    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170903    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 15:12:17.175574 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170905    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170908    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170911    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170914    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170916    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170918    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170921    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170924    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170926    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170930    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170932    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170936    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170939    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170942    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170945    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170948    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170950    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170953    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170955    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 15:12:17.176050 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170958    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170960    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170963    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170966    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170968    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170971    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170973    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170975    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170978    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170980    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170983    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170985    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170988    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170990    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170993    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170995    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.170998    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171000    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171002    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171006    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 15:12:17.176579 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171009    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171012    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171015    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171017    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171020    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171022    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171025    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171028    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171030    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171032    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171035    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171038    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171040    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171042    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171045    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171047    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171051    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171054    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171057    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171059    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 15:12:17.177072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171062    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171065    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171068    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171071    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171073    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171076    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171079    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171082    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171084    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171087    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171089    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171091    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171094    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171096    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171099    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171101    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171104    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171106    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171109    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171111    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 15:12:17.177563 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:17.171114    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 15:12:17.178032 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.171119    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 15:12:17.178032 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.171233    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 19 15:12:17.178032 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.173446    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 19 15:12:17.178032 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.174451    2562 server.go:1019] "Starting client certificate rotation"
Sep 19 15:12:17.178032 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.174558    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 15:12:17.178032 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.174587    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 15:12:17.178032 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.177065    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 15:12:17.178329 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.178111    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 15:12:17.189846 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.189831    2562 log.go:25] "Validated CRI v1 runtime API"
Sep 19 15:12:17.191497 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.191483    2562 log.go:25] "Validated CRI v1 image API"
Sep 19 15:12:17.192275 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.192258    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 19 15:12:17.196528 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.196510    2562 fs.go:135] Filesystem UUIDs: map[735aa7f5-0492-4b80-8106-5ff3e4f279c0:/dev/nvme0n1p3 73e60681-f62c-4b5d-8f5a-bdb4e6101aba:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 19 15:12:17.196588 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.196527    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 19 15:12:17.202166 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.202054    2562 manager.go:216] Machine: {Timestamp:2026-09-19 15:12:17.20001752 +0000 UTC m=+0.363432551 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3088225 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d1177b668d729918f4aec4e579611 SystemUUID:ec2d1177-b668-d729-918f-4aec4e579611 BootID:e743f4dc-1348-439a-85c7-fefa94e32859 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e5:dc:79:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e5:dc:79:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:b1:8f:c3:d4:cd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 19 15:12:17.202166 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.202163    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 19 15:12:17.202312 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.202297    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 19 15:12:17.204738 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.204723    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 15:12:17.205605 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.205578    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 19 15:12:17.205723 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.205609    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-152.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 19 15:12:17.207162 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.207152    2562 topology_manager.go:138] "Creating topology manager with none policy"
Sep 19 15:12:17.207220 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.207167    2562 container_manager_linux.go:309] "Creating device plugin manager"
Sep 19 15:12:17.207220 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.207179    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 15:12:17.207961 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.207952    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 15:12:17.209528 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.209518    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 19 15:12:17.213716 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.213705    2562 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 15:12:17.213839 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.213830    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 19 15:12:17.213872 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.213858    2562 kubelet.go:486] "Attempting to sync node with API server"
Sep 19 15:12:17.213872 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.213868    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 19 15:12:17.213927 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.213887    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 19 15:12:17.213927 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.213903    2562 kubelet.go:398] "Adding apiserver pod source"
Sep 19 15:12:17.213927 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.213916    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 19 15:12:17.214281 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.214266    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 15:12:17.214356 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.214294    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 15:12:17.216522 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.216498    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 19 15:12:17.219360 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.219344    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 19 15:12:17.219435 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.219382    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 19 15:12:17.221717 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.221703    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 19 15:12:17.221794 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.221726    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 19 15:12:17.221794 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.221734    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 19 15:12:17.221794 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.221742    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 19 15:12:17.221794 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.221754    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 19 15:12:17.221794 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.221762    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 19 15:12:17.221794 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.221780    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 19 15:12:17.221794 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.221789    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 19 15:12:17.222030 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.221800    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 19 15:12:17.222030 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.221809    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 19 15:12:17.222030 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.221823    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 19 15:12:17.222030 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.221831    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 19 15:12:17.222740 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.222728    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 19 15:12:17.222791 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.222744    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 19 15:12:17.223631 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.223615    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sk46t"
Sep 19 15:12:17.225009 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.224986    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 19 15:12:17.225118 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.225009    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 19 15:12:17.226592 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.226576    2562 server.go:1268] "Started kubelet"
Sep 19 15:12:17.226697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.226678    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 19 15:12:17.226746 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.226674    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 19 15:12:17.226746 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.226734    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 19 15:12:17.227318 ip-10-0-132-152 systemd[1]: Started Kubernetes Kubelet.
Sep 19 15:12:17.231216 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.231177    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 19 15:12:17.231978 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.231957    2562 server.go:310] "Adding debug handlers to kubelet server"
Sep 19 15:12:17.232116 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.232095    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sk46t"
Sep 19 15:12:17.232842 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.232737    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 19 15:12:17.236657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.236641    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-152.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 19 15:12:17.237933 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.236709    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-152.ec2.internal.18d6c1929476c806  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-152.ec2.internal,UID:ip-10-0-132-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-152.ec2.internal,},FirstTimestamp:2026-09-19 15:12:17.226549254 +0000 UTC m=+0.389964285,LastTimestamp:2026-09-19 15:12:17.226549254 +0000 UTC m=+0.389964285,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-152.ec2.internal,}"
Sep 19 15:12:17.243053 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.243037    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 19 15:12:17.243053 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.243044    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 19 15:12:17.243663 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.243274    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found"
Sep 19 15:12:17.243786 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.243763    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 19 15:12:17.243857 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.243785    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 19 15:12:17.243925 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.243916    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 19 15:12:17.244084 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.244065    2562 factory.go:55] Registering systemd factory
Sep 19 15:12:17.244157 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.244089    2562 factory.go:223] Registration of the systemd container factory successfully
Sep 19 15:12:17.244157 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.244066    2562 reconstruct.go:97] "Volume reconstruction finished"
Sep 19 15:12:17.244157 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.244127    2562 reconciler.go:29] "Reconciler: start to sync state"
Sep 19 15:12:17.244326 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.244309    2562 factory.go:153] Registering CRI-O factory
Sep 19 15:12:17.244326 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.244321    2562 factory.go:223] Registration of the crio container factory successfully
Sep 19 15:12:17.244412 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.244370    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 19 15:12:17.244412 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.244387    2562 factory.go:103] Registering Raw factory
Sep 19 15:12:17.244412 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.244400    2562 manager.go:1196] Started watching for new ooms in manager
Sep 19 15:12:17.244893 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.244880    2562 manager.go:349] Starting recovery of all containers
Sep 19 15:12:17.245145 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.245130    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 15:12:17.247426 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.247407    2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-152.ec2.internal\" not found" node="ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.256340 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.256325    2562 manager.go:354] Recovery completed
Sep 19 15:12:17.260979 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.260966    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 15:12:17.262693 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.262679    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 15:12:17.262761 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.262711    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 15:12:17.262761 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.262722    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientPID"
Sep 19 15:12:17.263286 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.263263    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 19 15:12:17.263286 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.263278    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 19 15:12:17.263286 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.263270    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 15:12:17.263438 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.263295    2562 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 15:12:17.264313 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.264296    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 15:12:17.264405 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.264331    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 15:12:17.264405 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.264346    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientPID"
Sep 19 15:12:17.265416 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.265403    2562 policy_none.go:49] "None policy: Start"
Sep 19 15:12:17.265462 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.265420    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 19 15:12:17.265462 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.265430    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 19 15:12:17.267382 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.267372    2562 policy_none.go:47] "Start"
Sep 19 15:12:17.305752 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.305734    2562 manager.go:337] "Starting Device Plugin manager"
Sep 19 15:12:17.322391 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.305768    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 19 15:12:17.322391 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.305777    2562 server.go:87] "Starting device plugin registration server"
Sep 19 15:12:17.322391 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.305982    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 19 15:12:17.322391 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.305995    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 19 15:12:17.322391 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.306075    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 19 15:12:17.322391 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.306151    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 19 15:12:17.322391 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.306159    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 19 15:12:17.322391 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.306708    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 19 15:12:17.322391 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.306758    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-152.ec2.internal\" not found"
Sep 19 15:12:17.336262 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.336233    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 19 15:12:17.337650 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.337627    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 19 15:12:17.337735 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.337664    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 19 15:12:17.337735 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.337682    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 19 15:12:17.337735 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.337723    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 19 15:12:17.339896 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.339879    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 15:12:17.406663 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.406616    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 15:12:17.407378 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.407363    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 15:12:17.407443 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.407390    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 15:12:17.407443 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.407401    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientPID"
Sep 19 15:12:17.407443 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.407419    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.414709 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.414695    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.414781 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.414713    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-152.ec2.internal\": node \"ip-10-0-132-152.ec2.internal\" not found"
Sep 19 15:12:17.429239 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.429216    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found"
Sep 19 15:12:17.438758 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.438738    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal"]
Sep 19 15:12:17.438819 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.438789    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 15:12:17.440186 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.440168    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 15:12:17.440265 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.440213    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 15:12:17.440265 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.440224    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientPID"
Sep 19 15:12:17.442390 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.442378    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 15:12:17.442530 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.442518    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.442569 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.442543    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 15:12:17.443096 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.443079    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 15:12:17.443170 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.443108    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 15:12:17.443170 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.443125    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientPID"
Sep 19 15:12:17.443284 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.443082    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 15:12:17.443284 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.443228    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 15:12:17.443284 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.443240    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientPID"
Sep 19 15:12:17.444958 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.444943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c721ff32f78bcb4fe4d35da615030e73-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal\" (UID: \"c721ff32f78bcb4fe4d35da615030e73\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.445002 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.444964    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c95e12dfda0431cef9884d54113acd82-config\") pod \"kube-apiserver-proxy-ip-10-0-132-152.ec2.internal\" (UID: \"c95e12dfda0431cef9884d54113acd82\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.445002 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.444979    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c721ff32f78bcb4fe4d35da615030e73-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal\" (UID: \"c721ff32f78bcb4fe4d35da615030e73\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.445422 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.445407    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.445463 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.445443    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 15:12:17.447179 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.447164    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 15:12:17.447261 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.447218    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 15:12:17.447261 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.447234    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientPID"
Sep 19 15:12:17.475784 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.475768    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-152.ec2.internal\" not found" node="ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.480175 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.480161    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-152.ec2.internal\" not found" node="ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.529892 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.529878    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found"
Sep 19 15:12:17.545957 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.545942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c721ff32f78bcb4fe4d35da615030e73-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal\" (UID: \"c721ff32f78bcb4fe4d35da615030e73\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.546019 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.545966    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c721ff32f78bcb4fe4d35da615030e73-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal\" (UID: \"c721ff32f78bcb4fe4d35da615030e73\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.546019 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.545986    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c95e12dfda0431cef9884d54113acd82-config\") pod \"kube-apiserver-proxy-ip-10-0-132-152.ec2.internal\" (UID: \"c95e12dfda0431cef9884d54113acd82\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.546080 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.546043    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c95e12dfda0431cef9884d54113acd82-config\") pod \"kube-apiserver-proxy-ip-10-0-132-152.ec2.internal\" (UID: \"c95e12dfda0431cef9884d54113acd82\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.546080 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.546069    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c721ff32f78bcb4fe4d35da615030e73-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal\" (UID: \"c721ff32f78bcb4fe4d35da615030e73\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.546143 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.546043    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c721ff32f78bcb4fe4d35da615030e73-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal\" (UID: \"c721ff32f78bcb4fe4d35da615030e73\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.630735 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.630703    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found"
Sep 19 15:12:17.731467 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.731415    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found"
Sep 19 15:12:17.778951 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.778928    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.784370 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:17.784021    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal"
Sep 19 15:12:17.831514 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.831484    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found"
Sep 19 15:12:17.932008 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:17.931985    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found"
Sep 19 15:12:18.032498 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:18.032439    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found"
Sep 19 15:12:18.133079 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:18.133047    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found"
Sep 19 15:12:18.174572 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:18.174446    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 19 15:12:18.174956 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:18.174724    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 19 15:12:18.174956 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:18.174730    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 19 15:12:18.233547 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:18.233525    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found"
Sep 19 15:12:18.238441 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:18.238411    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-18 15:07:18 +0000 UTC" deadline="2028-05-28 01:03:05.466470042 +0000 UTC"
Sep 19 15:12:18.238441 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:18.238439    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14793h50m47.228034349s"
Sep 19 15:12:18.241779 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:18.241761    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 15:12:18.243235 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:18.243219    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 19 15:12:18.243308 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:18.243262    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal"
Sep 19 15:12:18.252619 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:18.252603    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 15:12:18.254463 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:18.254449    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 15:12:18.254528 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:18.254480    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal"
Sep 19 15:12:18.264987 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:18.264974    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 15:12:18.271272 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:18.271256    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gtsxb"
Sep 19 15:12:18.277017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:18.277004    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gtsxb"
Sep 19 15:12:18.345451 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:18.345421    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc95e12dfda0431cef9884d54113acd82.slice/crio-1e8356628d60f7c38c3581c7e7747872320a3dbf3e963492652c3748c08ba88f WatchSource:0}: Error finding container 1e8356628d60f7c38c3581c7e7747872320a3dbf3e963492652c3748c08ba88f: Status 404 returned error can't find the container with id 1e8356628d60f7c38c3581c7e7747872320a3dbf3e963492652c3748c08ba88f
Sep 19 15:12:18.346815 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:18.346060    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc721ff32f78bcb4fe4d35da615030e73.slice/crio-6d68120f42f1e3791c15aa5edeb9733e7ad1716407d169f85f9bd223fa3d6de3 WatchSource:0}: Error finding container 6d68120f42f1e3791c15aa5edeb9733e7ad1716407d169f85f9bd223fa3d6de3: Status 404 returned error can't find the container with id 6d68120f42f1e3791c15aa5edeb9733e7ad1716407d169f85f9bd223fa3d6de3
Sep 19 15:12:18.352272 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:18.352256    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 15:12:18.766421 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:18.766372    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 15:12:19.214860 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.214818    2562 apiserver.go:52] "Watching apiserver"
Sep 19 15:12:19.220818 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.220653    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 19 15:12:19.224252 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.224199    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-mp2z5","openshift-network-operator/iptables-alerter-7tvm7","openshift-ovn-kubernetes/ovnkube-node-nmb2t","kube-system/global-pull-secret-syncer-gqhmn","kube-system/konnectivity-agent-55xl9","kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal","openshift-cluster-node-tuning-operator/tuned-58r2q","openshift-dns/node-resolver-4xcgl","openshift-image-registry/node-ca-xzf7q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal","openshift-multus/multus-additional-cni-plugins-hp2zp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt","openshift-multus/multus-gwcr6","openshift-multus/network-metrics-daemon-tmbmf"]
Sep 19 15:12:19.227047 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.227014    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.229242 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.229218    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9jc4h\""
Sep 19 15:12:19.229242 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.229202    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 19 15:12:19.229536 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.229519    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 19 15:12:19.229599 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.229586    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.231721 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.231583    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 19 15:12:19.232739 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.231865    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.232739 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.232049    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 19 15:12:19.232739 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.232263    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 19 15:12:19.232739 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.232612    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4zs8l\""
Sep 19 15:12:19.232739 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.232638    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 19 15:12:19.234117 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.234096    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 19 15:12:19.234448 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.234424    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:19.234556 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.234528    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqhmn" podUID="b24d686f-e9ed-4920-af05-39519e7c35a0"
Sep 19 15:12:19.234755 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.234690    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 19 15:12:19.234987 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.234966    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vvp9d\""
Sep 19 15:12:19.235063 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.235007    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 19 15:12:19.235205 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.235185    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 19 15:12:19.235438 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.235419    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 19 15:12:19.235551 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.235445    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 19 15:12:19.236796 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.236776    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-55xl9"
Sep 19 15:12:19.239046 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.239017    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 19 15:12:19.239046 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.239037    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 19 15:12:19.239334 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.239317    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x27p5\""
Sep 19 15:12:19.239415 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.239358    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:19.239504 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.239468    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:12:19.242056 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.242040    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xzf7q"
Sep 19 15:12:19.244811 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.244794    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:19.244914 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.244851    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp2z5" podUID="e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995"
Sep 19 15:12:19.245216 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.245147    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 19 15:12:19.245295 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.245249    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nl87t\""
Sep 19 15:12:19.245351 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.245303    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 19 15:12:19.245585 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.245568    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 19 15:12:19.247836 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.247815    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7tvm7"
Sep 19 15:12:19.250072 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.250013    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 19 15:12:19.250301 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.250249    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 19 15:12:19.250435 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.250386    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4xcgl"
Sep 19 15:12:19.250816 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.250608    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lm6wq\""
Sep 19 15:12:19.250816 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.250798    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 19 15:12:19.253448 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.253427    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 19 15:12:19.253579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.253562    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-92tjb\""
Sep 19 15:12:19.253763 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.253741    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 19 15:12:19.254129 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254110    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.256457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254486    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-run-k8s-cni-cncf-io\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.256457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254537    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret\") pod \"global-pull-secret-syncer-gqhmn\" (UID: \"b24d686f-e9ed-4920-af05-39519e7c35a0\") " pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:19.256457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d52154d-1cc7-4041-a644-59b431ba759c-host\") pod \"node-ca-xzf7q\" (UID: \"6d52154d-1cc7-4041-a644-59b431ba759c\") " pod="openshift-image-registry/node-ca-xzf7q"
Sep 19 15:12:19.256457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254571    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-run-ovn\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.256457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254590    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-node-log\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.256457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254605    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-lib-modules\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.256457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254625    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aca63a0-9cfb-48b7-8427-459bf0649d60-tmp\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.256457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-ovnkube-script-lib\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.256457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254664    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-kubernetes\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.256457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-run-netns\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.256457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254765    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-var-lib-kubelet\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.256457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-multus-socket-dir-parent\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.256457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254806    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b24d686f-e9ed-4920-af05-39519e7c35a0-kubelet-config\") pod \"global-pull-secret-syncer-gqhmn\" (UID: \"b24d686f-e9ed-4920-af05-39519e7c35a0\") " pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:19.256457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254820    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-etc-openvswitch\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.256457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254839    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-cni-netd\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.256457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254865    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-var-lib-cni-multus\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.256457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254886    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-sysconfig\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.257414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254909    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6frfs\" (UniqueName: \"kubernetes.io/projected/3aca63a0-9cfb-48b7-8427-459bf0649d60-kube-api-access-6frfs\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.257414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254924    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6d52154d-1cc7-4041-a644-59b431ba759c-serviceca\") pod \"node-ca-xzf7q\" (UID: \"6d52154d-1cc7-4041-a644-59b431ba759c\") " pod="openshift-image-registry/node-ca-xzf7q"
Sep 19 15:12:19.257414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254937    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-kubelet\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.257414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-systemd-units\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.257414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254977    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-multus-conf-dir\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.257414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.254998    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs\") pod \"network-metrics-daemon-tmbmf\" (UID: \"01ca12cf-99c7-4835-b150-0b653dfc1905\") " pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:19.257414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-slash\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.257414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255026    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-ovnkube-config\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.257414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255057    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-env-overrides\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.257414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255089    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-modprobe-d\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.257414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn4gs\" (UniqueName: \"kubernetes.io/projected/6d52154d-1cc7-4041-a644-59b431ba759c-kube-api-access-rn4gs\") pod \"node-ca-xzf7q\" (UID: \"6d52154d-1cc7-4041-a644-59b431ba759c\") " pod="openshift-image-registry/node-ca-xzf7q"
Sep 19 15:12:19.257414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255139    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-run-netns\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.257414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255152    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-run-systemd\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.257414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-systemd\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.257414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255192    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-sys\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.257414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255260    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-tuned\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.257414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255294    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-system-cni-dir\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.258245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255312    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-var-lib-cni-bin\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.258245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-cnibin\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.258245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255407    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa837c9f-9e43-4dec-a8ae-637125174f5d-cni-binary-copy\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.258245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255423    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dkg4\" (UniqueName: \"kubernetes.io/projected/01ca12cf-99c7-4835-b150-0b653dfc1905-kube-api-access-8dkg4\") pod \"network-metrics-daemon-tmbmf\" (UID: \"01ca12cf-99c7-4835-b150-0b653dfc1905\") " pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:19.258245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255444    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwtjs\" (UniqueName: \"kubernetes.io/projected/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-kube-api-access-bwtjs\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.258245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255466    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-run\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.258245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255542    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-var-lib-openvswitch\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.258245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255623    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-log-socket\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.258245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.258245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255806    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv5jd\" (UniqueName: \"kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd\") pod \"network-check-target-mp2z5\" (UID: \"e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995\") " pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:19.258245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255836    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-sysctl-conf\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.258245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255870    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.258245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255926    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-hostroot\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.258245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-multus-cni-dir\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.258245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255970    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aa837c9f-9e43-4dec-a8ae-637125174f5d-multus-daemon-config\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.258245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.255993    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-etc-kubernetes\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.259029 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.256011    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7tfp\" (UniqueName: \"kubernetes.io/projected/aa837c9f-9e43-4dec-a8ae-637125174f5d-kube-api-access-j7tfp\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.259029 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.256027    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/64d9e6c6-4c5e-4dbf-b313-48309f1fc05f-agent-certs\") pod \"konnectivity-agent-55xl9\" (UID: \"64d9e6c6-4c5e-4dbf-b313-48309f1fc05f\") " pod="kube-system/konnectivity-agent-55xl9"
Sep 19 15:12:19.259029 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.256219    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-cni-bin\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.259029 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.256303    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-var-lib-kubelet\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.259029 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.256396    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-run-multus-certs\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.259029 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.256435    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b24d686f-e9ed-4920-af05-39519e7c35a0-dbus\") pod \"global-pull-secret-syncer-gqhmn\" (UID: \"b24d686f-e9ed-4920-af05-39519e7c35a0\") " pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:19.259029 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.256473    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-ovn-node-metrics-cert\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.259029 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.256496    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-sysctl-d\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.259029 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.256531    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-host\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.259029 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.256556    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/64d9e6c6-4c5e-4dbf-b313-48309f1fc05f-konnectivity-ca\") pod \"konnectivity-agent-55xl9\" (UID: \"64d9e6c6-4c5e-4dbf-b313-48309f1fc05f\") " pod="kube-system/konnectivity-agent-55xl9"
Sep 19 15:12:19.259029 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.256582    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-run-openvswitch\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.259029 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.256843    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.262158 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.262061    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 19 15:12:19.264915 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.262861    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 19 15:12:19.264915 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.263496    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nz4tp\""
Sep 19 15:12:19.264915 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.263889    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 19 15:12:19.264915 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.264017    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vtsv4\""
Sep 19 15:12:19.264915 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.264052    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 19 15:12:19.264915 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.264190    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 19 15:12:19.280039 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.280001    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 15:07:19 +0000 UTC" deadline="2028-05-31 13:37:03.448924382 +0000 UTC"
Sep 19 15:12:19.280039 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.280038    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14878h24m44.168890066s"
Sep 19 15:12:19.291819 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.291796    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 15:12:19.344406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.344357    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal" event={"ID":"c95e12dfda0431cef9884d54113acd82","Type":"ContainerStarted","Data":"1e8356628d60f7c38c3581c7e7747872320a3dbf3e963492652c3748c08ba88f"}
Sep 19 15:12:19.344580 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.344564    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 19 15:12:19.346077 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.346054    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal" event={"ID":"c721ff32f78bcb4fe4d35da615030e73","Type":"ContainerStarted","Data":"6d68120f42f1e3791c15aa5edeb9733e7ad1716407d169f85f9bd223fa3d6de3"}
Sep 19 15:12:19.356988 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.356958    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-modprobe-d\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.356988 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.356989    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn4gs\" (UniqueName: \"kubernetes.io/projected/6d52154d-1cc7-4041-a644-59b431ba759c-kube-api-access-rn4gs\") pod \"node-ca-xzf7q\" (UID: \"6d52154d-1cc7-4041-a644-59b431ba759c\") " pod="openshift-image-registry/node-ca-xzf7q"
Sep 19 15:12:19.357143 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357007    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-run-netns\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.357143 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357028    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-run-systemd\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.357143 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357118    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-run-netns\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.357324 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357058    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-cnibin\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.357324 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357150    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-run-systemd\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.357324 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-systemd\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.357324 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357181    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-modprobe-d\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.357324 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357202    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-sys\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.357324 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-tuned\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.357324 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357273    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-system-cni-dir\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.357324 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357288    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-sys\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.357324 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c26f271f-4c0a-4303-963e-df1323fa4bec-hosts-file\") pod \"node-resolver-4xcgl\" (UID: \"c26f271f-4c0a-4303-963e-df1323fa4bec\") " pod="openshift-dns/node-resolver-4xcgl"
Sep 19 15:12:19.357694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357333    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-systemd\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.357694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357359    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-var-lib-cni-bin\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.357694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357378    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-cnibin\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.357694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357446    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-var-lib-cni-bin\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.357694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357435    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-cnibin\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.357694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357459    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa837c9f-9e43-4dec-a8ae-637125174f5d-cni-binary-copy\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.357694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppbtc\" (UniqueName: \"kubernetes.io/projected/3324dc82-9965-41c2-b650-33794d1a73fd-kube-api-access-ppbtc\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.357694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357522    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-system-cni-dir\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.357694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357545    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dkg4\" (UniqueName: \"kubernetes.io/projected/01ca12cf-99c7-4835-b150-0b653dfc1905-kube-api-access-8dkg4\") pod \"network-metrics-daemon-tmbmf\" (UID: \"01ca12cf-99c7-4835-b150-0b653dfc1905\") " pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:19.357694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357568    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwtjs\" (UniqueName: \"kubernetes.io/projected/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-kube-api-access-bwtjs\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.357694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357585    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-socket-dir\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.357694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357599    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-device-dir\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.357694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357622    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-run\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.357694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-var-lib-openvswitch\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357716    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-run\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357713    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357753    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-var-lib-openvswitch\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357713    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-log-socket\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357794    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357812    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv5jd\" (UniqueName: \"kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd\") pod \"network-check-target-mp2z5\" (UID: \"e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995\") " pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357862    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n7wj\" (UniqueName: \"kubernetes.io/projected/c26f271f-4c0a-4303-963e-df1323fa4bec-kube-api-access-7n7wj\") pod \"node-resolver-4xcgl\" (UID: \"c26f271f-4c0a-4303-963e-df1323fa4bec\") " pod="openshift-dns/node-resolver-4xcgl"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357882    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-log-socket\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357908    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.357910    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-sysctl-conf\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358022    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa837c9f-9e43-4dec-a8ae-637125174f5d-cni-binary-copy\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-hostroot\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358044    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-sysctl-conf\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358057    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-multus-cni-dir\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358079    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aa837c9f-9e43-4dec-a8ae-637125174f5d-multus-daemon-config\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358099    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-etc-kubernetes\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.358419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358100    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358107    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-hostroot\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358120    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7tfp\" (UniqueName: \"kubernetes.io/projected/aa837c9f-9e43-4dec-a8ae-637125174f5d-kube-api-access-j7tfp\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358149    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/64d9e6c6-4c5e-4dbf-b313-48309f1fc05f-agent-certs\") pod \"konnectivity-agent-55xl9\" (UID: \"64d9e6c6-4c5e-4dbf-b313-48309f1fc05f\") " pod="kube-system/konnectivity-agent-55xl9"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-cni-bin\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358200    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-var-lib-kubelet\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358150    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-etc-kubernetes\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358250    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-run-multus-certs\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358237    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-multus-cni-dir\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358277    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b24d686f-e9ed-4920-af05-39519e7c35a0-dbus\") pod \"global-pull-secret-syncer-gqhmn\" (UID: \"b24d686f-e9ed-4920-af05-39519e7c35a0\") " pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358332    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-ovn-node-metrics-cert\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358343    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b24d686f-e9ed-4920-af05-39519e7c35a0-dbus\") pod \"global-pull-secret-syncer-gqhmn\" (UID: \"b24d686f-e9ed-4920-af05-39519e7c35a0\") " pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358357    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-run-multus-certs\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c545239-bdd5-409d-a620-e5796fc516ba-iptables-alerter-script\") pod \"iptables-alerter-7tvm7\" (UID: \"9c545239-bdd5-409d-a620-e5796fc516ba\") " pod="openshift-network-operator/iptables-alerter-7tvm7"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358424    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-sysctl-d\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358426    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-cni-bin\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358449    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-host\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358479    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/64d9e6c6-4c5e-4dbf-b313-48309f1fc05f-konnectivity-ca\") pod \"konnectivity-agent-55xl9\" (UID: \"64d9e6c6-4c5e-4dbf-b313-48309f1fc05f\") " pod="kube-system/konnectivity-agent-55xl9"
Sep 19 15:12:19.359408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358505    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-run-openvswitch\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358496    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-var-lib-kubelet\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358535    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-cni-binary-copy\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358575    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-sysctl-d\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358655    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-run-openvswitch\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358661    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aa837c9f-9e43-4dec-a8ae-637125174f5d-multus-daemon-config\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358690    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358719    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-host\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358755    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-run-k8s-cni-cncf-io\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358782    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret\") pod \"global-pull-secret-syncer-gqhmn\" (UID: \"b24d686f-e9ed-4920-af05-39519e7c35a0\") " pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358807    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d52154d-1cc7-4041-a644-59b431ba759c-host\") pod \"node-ca-xzf7q\" (UID: \"6d52154d-1cc7-4041-a644-59b431ba759c\") " pod="openshift-image-registry/node-ca-xzf7q"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358811    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-run-k8s-cni-cncf-io\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358831    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-run-ovn\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-node-log\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-lib-modules\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358896    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-run-ovn\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.360406 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.358898    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:19.361366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358855    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d52154d-1cc7-4041-a644-59b431ba759c-host\") pod \"node-ca-xzf7q\" (UID: \"6d52154d-1cc7-4041-a644-59b431ba759c\") " pod="openshift-image-registry/node-ca-xzf7q"
Sep 19 15:12:19.361366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358943    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-node-log\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.361366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.358904    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aca63a0-9cfb-48b7-8427-459bf0649d60-tmp\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.361366 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.358993    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret podName:b24d686f-e9ed-4920-af05-39519e7c35a0 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:19.858968893 +0000 UTC m=+3.022383932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret") pod "global-pull-secret-syncer-gqhmn" (UID: "b24d686f-e9ed-4920-af05-39519e7c35a0") : object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:19.361366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359017    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-ovnkube-script-lib\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.361366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359048    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/64d9e6c6-4c5e-4dbf-b313-48309f1fc05f-konnectivity-ca\") pod \"konnectivity-agent-55xl9\" (UID: \"64d9e6c6-4c5e-4dbf-b313-48309f1fc05f\") " pod="kube-system/konnectivity-agent-55xl9"
Sep 19 15:12:19.361366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359051    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.361366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359079    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.361366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359107    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-registration-dir\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.361366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359140    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-lib-modules\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.361366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359144    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c545239-bdd5-409d-a620-e5796fc516ba-host-slash\") pod \"iptables-alerter-7tvm7\" (UID: \"9c545239-bdd5-409d-a620-e5796fc516ba\") " pod="openshift-network-operator/iptables-alerter-7tvm7"
Sep 19 15:12:19.361366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359174    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-kubernetes\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.361366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359210    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c26f271f-4c0a-4303-963e-df1323fa4bec-tmp-dir\") pod \"node-resolver-4xcgl\" (UID: \"c26f271f-4c0a-4303-963e-df1323fa4bec\") " pod="openshift-dns/node-resolver-4xcgl"
Sep 19 15:12:19.361366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359265    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc7ll\" (UniqueName: \"kubernetes.io/projected/9c545239-bdd5-409d-a620-e5796fc516ba-kube-api-access-cc7ll\") pod \"iptables-alerter-7tvm7\" (UID: \"9c545239-bdd5-409d-a620-e5796fc516ba\") " pod="openshift-network-operator/iptables-alerter-7tvm7"
Sep 19 15:12:19.361366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359283    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-kubernetes\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.361366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-run-netns\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.362089 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359350    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-var-lib-kubelet\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.362089 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359395    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-run-netns\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.362089 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359434    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-var-lib-kubelet\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.362089 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359468    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-multus-socket-dir-parent\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.362089 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b24d686f-e9ed-4920-af05-39519e7c35a0-kubelet-config\") pod \"global-pull-secret-syncer-gqhmn\" (UID: \"b24d686f-e9ed-4920-af05-39519e7c35a0\") " pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:19.362089 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-etc-openvswitch\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.362089 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-cni-netd\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.362089 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359575    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-system-cni-dir\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.362089 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359597    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b24d686f-e9ed-4920-af05-39519e7c35a0-kubelet-config\") pod \"global-pull-secret-syncer-gqhmn\" (UID: \"b24d686f-e9ed-4920-af05-39519e7c35a0\") " pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:19.362089 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359654    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-cni-netd\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.362089 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359695    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-etc-openvswitch\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.362089 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359793    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-multus-socket-dir-parent\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.362089 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359601    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-var-lib-cni-multus\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.362089 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359831    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-sysconfig\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.362089 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359837    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-host-var-lib-cni-multus\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.362089 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359862    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6frfs\" (UniqueName: \"kubernetes.io/projected/3aca63a0-9cfb-48b7-8427-459bf0649d60-kube-api-access-6frfs\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.362089 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359889    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6d52154d-1cc7-4041-a644-59b431ba759c-serviceca\") pod \"node-ca-xzf7q\" (UID: \"6d52154d-1cc7-4041-a644-59b431ba759c\") " pod="openshift-image-registry/node-ca-xzf7q"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-kubelet\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359944    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-systemd-units\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359973    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-sys-fs\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.360023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-multus-conf-dir\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.360050    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs\") pod \"network-metrics-daemon-tmbmf\" (UID: \"01ca12cf-99c7-4835-b150-0b653dfc1905\") " pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.360088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-slash\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.360126    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-systemd-units\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.360131    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-ovnkube-config\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.360192    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-env-overrides\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.360222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmv7n\" (UniqueName: \"kubernetes.io/projected/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-kube-api-access-cmv7n\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.360781    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6d52154d-1cc7-4041-a644-59b431ba759c-serviceca\") pod \"node-ca-xzf7q\" (UID: \"6d52154d-1cc7-4041-a644-59b431ba759c\") " pod="openshift-image-registry/node-ca-xzf7q"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.359890    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-sysconfig\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.360852    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-kubelet\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.360943    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-ovnkube-script-lib\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.360994    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-ovnkube-config\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.361015    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa837c9f-9e43-4dec-a8ae-637125174f5d-multus-conf-dir\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.361069    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-host-slash\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.362824 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.361093    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:19.363479 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.361139    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs podName:01ca12cf-99c7-4835-b150-0b653dfc1905 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:19.861123952 +0000 UTC m=+3.024538986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs") pod "network-metrics-daemon-tmbmf" (UID: "01ca12cf-99c7-4835-b150-0b653dfc1905") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:19.363479 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.361190    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-env-overrides\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.363479 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.362377    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aca63a0-9cfb-48b7-8427-459bf0649d60-tmp\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.363479 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.362405    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3aca63a0-9cfb-48b7-8427-459bf0649d60-etc-tuned\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.363479 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.362566    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/64d9e6c6-4c5e-4dbf-b313-48309f1fc05f-agent-certs\") pod \"konnectivity-agent-55xl9\" (UID: \"64d9e6c6-4c5e-4dbf-b313-48309f1fc05f\") " pod="kube-system/konnectivity-agent-55xl9"
Sep 19 15:12:19.363971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.363950    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-ovn-node-metrics-cert\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.367716 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.367686    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 15:12:19.367804 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.367721    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 15:12:19.367804 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.367737    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tv5jd for pod openshift-network-diagnostics/network-check-target-mp2z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:19.367804 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.367795    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd podName:e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:19.86777886 +0000 UTC m=+3.031193911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tv5jd" (UniqueName: "kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd") pod "network-check-target-mp2z5" (UID: "e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:19.373292 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.369695    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn4gs\" (UniqueName: \"kubernetes.io/projected/6d52154d-1cc7-4041-a644-59b431ba759c-kube-api-access-rn4gs\") pod \"node-ca-xzf7q\" (UID: \"6d52154d-1cc7-4041-a644-59b431ba759c\") " pod="openshift-image-registry/node-ca-xzf7q"
Sep 19 15:12:19.373292 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.370617    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwtjs\" (UniqueName: \"kubernetes.io/projected/b9ca203c-13ed-409b-81de-e1e5bb26c0c3-kube-api-access-bwtjs\") pod \"ovnkube-node-nmb2t\" (UID: \"b9ca203c-13ed-409b-81de-e1e5bb26c0c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.373292 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.370658    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6frfs\" (UniqueName: \"kubernetes.io/projected/3aca63a0-9cfb-48b7-8427-459bf0649d60-kube-api-access-6frfs\") pod \"tuned-58r2q\" (UID: \"3aca63a0-9cfb-48b7-8427-459bf0649d60\") " pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.373292 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.372403    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dkg4\" (UniqueName: \"kubernetes.io/projected/01ca12cf-99c7-4835-b150-0b653dfc1905-kube-api-access-8dkg4\") pod \"network-metrics-daemon-tmbmf\" (UID: \"01ca12cf-99c7-4835-b150-0b653dfc1905\") " pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:19.374528 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.374510    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7tfp\" (UniqueName: \"kubernetes.io/projected/aa837c9f-9e43-4dec-a8ae-637125174f5d-kube-api-access-j7tfp\") pod \"multus-gwcr6\" (UID: \"aa837c9f-9e43-4dec-a8ae-637125174f5d\") " pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.460848 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.460809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-cni-binary-copy\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.460994 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.460856    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.460994 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.460885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.460994 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.460912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.460994 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.460953    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.460994 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.460979    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.461285 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-registration-dir\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.461285 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461024    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c545239-bdd5-409d-a620-e5796fc516ba-host-slash\") pod \"iptables-alerter-7tvm7\" (UID: \"9c545239-bdd5-409d-a620-e5796fc516ba\") " pod="openshift-network-operator/iptables-alerter-7tvm7"
Sep 19 15:12:19.461285 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461051    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c26f271f-4c0a-4303-963e-df1323fa4bec-tmp-dir\") pod \"node-resolver-4xcgl\" (UID: \"c26f271f-4c0a-4303-963e-df1323fa4bec\") " pod="openshift-dns/node-resolver-4xcgl"
Sep 19 15:12:19.461285 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461066    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.461285 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461075    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc7ll\" (UniqueName: \"kubernetes.io/projected/9c545239-bdd5-409d-a620-e5796fc516ba-kube-api-access-cc7ll\") pod \"iptables-alerter-7tvm7\" (UID: \"9c545239-bdd5-409d-a620-e5796fc516ba\") " pod="openshift-network-operator/iptables-alerter-7tvm7"
Sep 19 15:12:19.461285 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461097    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.461285 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461120    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-system-cni-dir\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.461285 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461153    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-system-cni-dir\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.461285 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461170    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-sys-fs\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.461285 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461210    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-registration-dir\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.461285 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461239    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmv7n\" (UniqueName: \"kubernetes.io/projected/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-kube-api-access-cmv7n\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.461285 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461273    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-cnibin\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.461285 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461288    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.461971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461303    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c26f271f-4c0a-4303-963e-df1323fa4bec-hosts-file\") pod \"node-resolver-4xcgl\" (UID: \"c26f271f-4c0a-4303-963e-df1323fa4bec\") " pod="openshift-dns/node-resolver-4xcgl"
Sep 19 15:12:19.461971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461334    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c545239-bdd5-409d-a620-e5796fc516ba-host-slash\") pod \"iptables-alerter-7tvm7\" (UID: \"9c545239-bdd5-409d-a620-e5796fc516ba\") " pod="openshift-network-operator/iptables-alerter-7tvm7"
Sep 19 15:12:19.461971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461345    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppbtc\" (UniqueName: \"kubernetes.io/projected/3324dc82-9965-41c2-b650-33794d1a73fd-kube-api-access-ppbtc\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.461971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461374    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-socket-dir\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.461971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461408    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-device-dir\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.461971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461450    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n7wj\" (UniqueName: \"kubernetes.io/projected/c26f271f-4c0a-4303-963e-df1323fa4bec-kube-api-access-7n7wj\") pod \"node-resolver-4xcgl\" (UID: \"c26f271f-4c0a-4303-963e-df1323fa4bec\") " pod="openshift-dns/node-resolver-4xcgl"
Sep 19 15:12:19.461971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c545239-bdd5-409d-a620-e5796fc516ba-iptables-alerter-script\") pod \"iptables-alerter-7tvm7\" (UID: \"9c545239-bdd5-409d-a620-e5796fc516ba\") " pod="openshift-network-operator/iptables-alerter-7tvm7"
Sep 19 15:12:19.461971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461505    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-cni-binary-copy\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.461971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461562    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.461971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461584    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-cnibin\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.461971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461635    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c26f271f-4c0a-4303-963e-df1323fa4bec-hosts-file\") pod \"node-resolver-4xcgl\" (UID: \"c26f271f-4c0a-4303-963e-df1323fa4bec\") " pod="openshift-dns/node-resolver-4xcgl"
Sep 19 15:12:19.461971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461646    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c26f271f-4c0a-4303-963e-df1323fa4bec-tmp-dir\") pod \"node-resolver-4xcgl\" (UID: \"c26f271f-4c0a-4303-963e-df1323fa4bec\") " pod="openshift-dns/node-resolver-4xcgl"
Sep 19 15:12:19.461971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461646    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-socket-dir\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.461971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461679    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-device-dir\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.461971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461696    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.461971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.461714    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3324dc82-9965-41c2-b650-33794d1a73fd-sys-fs\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.462799 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.462033    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c545239-bdd5-409d-a620-e5796fc516ba-iptables-alerter-script\") pod \"iptables-alerter-7tvm7\" (UID: \"9c545239-bdd5-409d-a620-e5796fc516ba\") " pod="openshift-network-operator/iptables-alerter-7tvm7"
Sep 19 15:12:19.472921 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.472841    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n7wj\" (UniqueName: \"kubernetes.io/projected/c26f271f-4c0a-4303-963e-df1323fa4bec-kube-api-access-7n7wj\") pod \"node-resolver-4xcgl\" (UID: \"c26f271f-4c0a-4303-963e-df1323fa4bec\") " pod="openshift-dns/node-resolver-4xcgl"
Sep 19 15:12:19.473068 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.473033    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmv7n\" (UniqueName: \"kubernetes.io/projected/1a4bb7a8-7c42-4d58-b35a-7e476a5f107d-kube-api-access-cmv7n\") pod \"multus-additional-cni-plugins-hp2zp\" (UID: \"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d\") " pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.474368 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.474346    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppbtc\" (UniqueName: \"kubernetes.io/projected/3324dc82-9965-41c2-b650-33794d1a73fd-kube-api-access-ppbtc\") pod \"aws-ebs-csi-driver-node-zl6dt\" (UID: \"3324dc82-9965-41c2-b650-33794d1a73fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.474624 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.474603    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc7ll\" (UniqueName: \"kubernetes.io/projected/9c545239-bdd5-409d-a620-e5796fc516ba-kube-api-access-cc7ll\") pod \"iptables-alerter-7tvm7\" (UID: \"9c545239-bdd5-409d-a620-e5796fc516ba\") " pod="openshift-network-operator/iptables-alerter-7tvm7"
Sep 19 15:12:19.541545 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.541506    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-58r2q"
Sep 19 15:12:19.550392 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.550370    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gwcr6"
Sep 19 15:12:19.565693 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.565673    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:19.573702 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.573684    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-55xl9"
Sep 19 15:12:19.583535 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.583520    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xzf7q"
Sep 19 15:12:19.591355 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.591337    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7tvm7"
Sep 19 15:12:19.599066 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.599050    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4xcgl"
Sep 19 15:12:19.604954 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.604933    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hp2zp"
Sep 19 15:12:19.609967 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.609950    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt"
Sep 19 15:12:19.689053 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.689026    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 15:12:19.864680 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.864648    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret\") pod \"global-pull-secret-syncer-gqhmn\" (UID: \"b24d686f-e9ed-4920-af05-39519e7c35a0\") " pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:19.864843 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.864692    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs\") pod \"network-metrics-daemon-tmbmf\" (UID: \"01ca12cf-99c7-4835-b150-0b653dfc1905\") " pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:19.864843 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.864806    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:19.864843 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.864812    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:19.864971 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.864884    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs podName:01ca12cf-99c7-4835-b150-0b653dfc1905 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:20.864860181 +0000 UTC m=+4.028275217 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs") pod "network-metrics-daemon-tmbmf" (UID: "01ca12cf-99c7-4835-b150-0b653dfc1905") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:19.864971 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.864914    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret podName:b24d686f-e9ed-4920-af05-39519e7c35a0 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:20.864900487 +0000 UTC m=+4.028315507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret") pod "global-pull-secret-syncer-gqhmn" (UID: "b24d686f-e9ed-4920-af05-39519e7c35a0") : object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:19.965600 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:19.965567    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv5jd\" (UniqueName: \"kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd\") pod \"network-check-target-mp2z5\" (UID: \"e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995\") " pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:19.965747 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.965705    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 15:12:19.965747 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.965723    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 15:12:19.965747 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.965733    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tv5jd for pod openshift-network-diagnostics/network-check-target-mp2z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:19.965865 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:19.965779    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd podName:e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:20.965766882 +0000 UTC m=+4.129181901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv5jd" (UniqueName: "kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd") pod "network-check-target-mp2z5" (UID: "e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:20.280394 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:20.280269    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 15:07:19 +0000 UTC" deadline="2028-05-11 12:09:55.97310447 +0000 UTC"
Sep 19 15:12:20.280394 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:20.280335    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14396h57m35.692773891s"
Sep 19 15:12:20.392183 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:20.390127    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d52154d_1cc7_4041_a644_59b431ba759c.slice/crio-fc5d222c92a0bdb1c6eac13a9609f38a6c46c52be95413d7d46ca4a57b5a4454 WatchSource:0}: Error finding container fc5d222c92a0bdb1c6eac13a9609f38a6c46c52be95413d7d46ca4a57b5a4454: Status 404 returned error can't find the container with id fc5d222c92a0bdb1c6eac13a9609f38a6c46c52be95413d7d46ca4a57b5a4454
Sep 19 15:12:20.392183 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:20.391893    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26f271f_4c0a_4303_963e_df1323fa4bec.slice/crio-b36288a5c025167d97639dbcb1397e3af5a0ea65422888c25ca9669a3da7c3ad WatchSource:0}: Error finding container b36288a5c025167d97639dbcb1397e3af5a0ea65422888c25ca9669a3da7c3ad: Status 404 returned error can't find the container with id b36288a5c025167d97639dbcb1397e3af5a0ea65422888c25ca9669a3da7c3ad
Sep 19 15:12:20.397413 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:20.397391    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa837c9f_9e43_4dec_a8ae_637125174f5d.slice/crio-c8a177f0c51174fabeb70106e7f73d67bd0e8c8ad8f964ea2ff60b82d5f4dcaa WatchSource:0}: Error finding container c8a177f0c51174fabeb70106e7f73d67bd0e8c8ad8f964ea2ff60b82d5f4dcaa: Status 404 returned error can't find the container with id c8a177f0c51174fabeb70106e7f73d67bd0e8c8ad8f964ea2ff60b82d5f4dcaa
Sep 19 15:12:20.399832 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:20.399810    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3324dc82_9965_41c2_b650_33794d1a73fd.slice/crio-38ea9f6aa50631bbf1dcbe56ad3777de832306fc363a2ce5ac66fe994bd78a59 WatchSource:0}: Error finding container 38ea9f6aa50631bbf1dcbe56ad3777de832306fc363a2ce5ac66fe994bd78a59: Status 404 returned error can't find the container with id 38ea9f6aa50631bbf1dcbe56ad3777de832306fc363a2ce5ac66fe994bd78a59
Sep 19 15:12:20.400816 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:20.400605    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64d9e6c6_4c5e_4dbf_b313_48309f1fc05f.slice/crio-ed1c2e27a62f3757b4f15a8094e1b9c982242d5b71758788209fe687491665a3 WatchSource:0}: Error finding container ed1c2e27a62f3757b4f15a8094e1b9c982242d5b71758788209fe687491665a3: Status 404 returned error can't find the container with id ed1c2e27a62f3757b4f15a8094e1b9c982242d5b71758788209fe687491665a3
Sep 19 15:12:20.401731 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:20.401704    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a4bb7a8_7c42_4d58_b35a_7e476a5f107d.slice/crio-116a615118aed473b135002a4616fac988b542bf4e791d086649b61aa74de1a0 WatchSource:0}: Error finding container 116a615118aed473b135002a4616fac988b542bf4e791d086649b61aa74de1a0: Status 404 returned error can't find the container with id 116a615118aed473b135002a4616fac988b542bf4e791d086649b61aa74de1a0
Sep 19 15:12:20.404522 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:20.403850    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ca203c_13ed_409b_81de_e1e5bb26c0c3.slice/crio-6c2685c5c10cf7c9ab76a5227cd85c0e0b6dc19e04086f0d3a5be38212a73f19 WatchSource:0}: Error finding container 6c2685c5c10cf7c9ab76a5227cd85c0e0b6dc19e04086f0d3a5be38212a73f19: Status 404 returned error can't find the container with id 6c2685c5c10cf7c9ab76a5227cd85c0e0b6dc19e04086f0d3a5be38212a73f19
Sep 19 15:12:20.871713 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:20.871674    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret\") pod \"global-pull-secret-syncer-gqhmn\" (UID: \"b24d686f-e9ed-4920-af05-39519e7c35a0\") " pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:20.871903 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:20.871744    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs\") pod \"network-metrics-daemon-tmbmf\" (UID: \"01ca12cf-99c7-4835-b150-0b653dfc1905\") " pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:20.871903 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:20.871894    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:20.872019 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:20.871957    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs podName:01ca12cf-99c7-4835-b150-0b653dfc1905 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:22.87193793 +0000 UTC m=+6.035352968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs") pod "network-metrics-daemon-tmbmf" (UID: "01ca12cf-99c7-4835-b150-0b653dfc1905") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:20.872430 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:20.872405    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:20.872516 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:20.872483    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret podName:b24d686f-e9ed-4920-af05-39519e7c35a0 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:22.872465746 +0000 UTC m=+6.035880768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret") pod "global-pull-secret-syncer-gqhmn" (UID: "b24d686f-e9ed-4920-af05-39519e7c35a0") : object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:20.973240 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:20.972987    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv5jd\" (UniqueName: \"kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd\") pod \"network-check-target-mp2z5\" (UID: \"e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995\") " pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:20.973424 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:20.973399    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 15:12:20.973424 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:20.973422    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 15:12:20.973557 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:20.973436    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tv5jd for pod openshift-network-diagnostics/network-check-target-mp2z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:20.973557 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:20.973499    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd podName:e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:22.973477607 +0000 UTC m=+6.136892632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv5jd" (UniqueName: "kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd") pod "network-check-target-mp2z5" (UID: "e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:21.341762 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:21.340820    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:21.341762 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:21.340963    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:12:21.341762 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:21.341416    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:21.341762 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:21.341517    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp2z5" podUID="e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995"
Sep 19 15:12:21.341762 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:21.341587    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:21.341762 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:21.341667    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqhmn" podUID="b24d686f-e9ed-4920-af05-39519e7c35a0"
Sep 19 15:12:21.365667 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:21.365633    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal" event={"ID":"c95e12dfda0431cef9884d54113acd82","Type":"ContainerStarted","Data":"abb21f79120fc598d9870c9183f3040b1461a4b85739d2c34df9909a727c5076"}
Sep 19 15:12:21.370822 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:21.370786    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t" event={"ID":"b9ca203c-13ed-409b-81de-e1e5bb26c0c3","Type":"ContainerStarted","Data":"6c2685c5c10cf7c9ab76a5227cd85c0e0b6dc19e04086f0d3a5be38212a73f19"}
Sep 19 15:12:21.376870 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:21.376838    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt" event={"ID":"3324dc82-9965-41c2-b650-33794d1a73fd","Type":"ContainerStarted","Data":"38ea9f6aa50631bbf1dcbe56ad3777de832306fc363a2ce5ac66fe994bd78a59"}
Sep 19 15:12:21.383084 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:21.383035    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gwcr6" event={"ID":"aa837c9f-9e43-4dec-a8ae-637125174f5d","Type":"ContainerStarted","Data":"c8a177f0c51174fabeb70106e7f73d67bd0e8c8ad8f964ea2ff60b82d5f4dcaa"}
Sep 19 15:12:21.392772 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:21.392739    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4xcgl" event={"ID":"c26f271f-4c0a-4303-963e-df1323fa4bec","Type":"ContainerStarted","Data":"b36288a5c025167d97639dbcb1397e3af5a0ea65422888c25ca9669a3da7c3ad"}
Sep 19 15:12:21.395057 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:21.395032    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xzf7q" event={"ID":"6d52154d-1cc7-4041-a644-59b431ba759c","Type":"ContainerStarted","Data":"fc5d222c92a0bdb1c6eac13a9609f38a6c46c52be95413d7d46ca4a57b5a4454"}
Sep 19 15:12:21.400092 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:21.399252    2562 generic.go:356] "Generic (PLEG): container finished" podID="c721ff32f78bcb4fe4d35da615030e73" containerID="9deacfa85c1e1211e5f0ed22ba70ac359be2de6748e1e8f33131a4e248ad8b9e" exitCode=0
Sep 19 15:12:21.400092 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:21.399364    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal" event={"ID":"c721ff32f78bcb4fe4d35da615030e73","Type":"ContainerDied","Data":"9deacfa85c1e1211e5f0ed22ba70ac359be2de6748e1e8f33131a4e248ad8b9e"}
Sep 19 15:12:21.407927 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:21.407896    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-58r2q" event={"ID":"3aca63a0-9cfb-48b7-8427-459bf0649d60","Type":"ContainerStarted","Data":"ee39947086a2a646f475b4583f6f55a51709ee3a5370174dc0414dd8dcab2c10"}
Sep 19 15:12:21.412468 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:21.412435    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7tvm7" event={"ID":"9c545239-bdd5-409d-a620-e5796fc516ba","Type":"ContainerStarted","Data":"fbf3ceb23bba7c91e69060dfa8e526845e9be35f94ec74d6df2649f70a430506"}
Sep 19 15:12:21.414594 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:21.413980    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal" podStartSLOduration=2.41396253 podStartE2EDuration="2.41396253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:21.379192167 +0000 UTC m=+4.542607212" watchObservedRunningTime="2026-09-19 15:12:21.41396253 +0000 UTC m=+4.577377578"
Sep 19 15:12:21.417482 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:21.417414    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hp2zp" event={"ID":"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d","Type":"ContainerStarted","Data":"116a615118aed473b135002a4616fac988b542bf4e791d086649b61aa74de1a0"}
Sep 19 15:12:21.420366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:21.420321    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-55xl9" event={"ID":"64d9e6c6-4c5e-4dbf-b313-48309f1fc05f","Type":"ContainerStarted","Data":"ed1c2e27a62f3757b4f15a8094e1b9c982242d5b71758788209fe687491665a3"}
Sep 19 15:12:22.441410 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:22.441331    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal" event={"ID":"c721ff32f78bcb4fe4d35da615030e73","Type":"ContainerStarted","Data":"cd5cb56ec0c1404cb995632a31c9388932f42ff4e7cc14259f59d690a082c3e8"}
Sep 19 15:12:22.888899 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:22.888837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret\") pod \"global-pull-secret-syncer-gqhmn\" (UID: \"b24d686f-e9ed-4920-af05-39519e7c35a0\") " pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:22.889086 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:22.888929    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs\") pod \"network-metrics-daemon-tmbmf\" (UID: \"01ca12cf-99c7-4835-b150-0b653dfc1905\") " pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:22.889183 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:22.889146    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:22.889313 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:22.889226    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs podName:01ca12cf-99c7-4835-b150-0b653dfc1905 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:26.889201901 +0000 UTC m=+10.052617015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs") pod "network-metrics-daemon-tmbmf" (UID: "01ca12cf-99c7-4835-b150-0b653dfc1905") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:22.889585 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:22.889564    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:22.889680 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:22.889637    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret podName:b24d686f-e9ed-4920-af05-39519e7c35a0 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:26.889618131 +0000 UTC m=+10.053033165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret") pod "global-pull-secret-syncer-gqhmn" (UID: "b24d686f-e9ed-4920-af05-39519e7c35a0") : object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:22.989366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:22.989328    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv5jd\" (UniqueName: \"kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd\") pod \"network-check-target-mp2z5\" (UID: \"e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995\") " pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:22.989589 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:22.989478    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 15:12:22.989589 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:22.989495    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 15:12:22.989589 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:22.989504    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tv5jd for pod openshift-network-diagnostics/network-check-target-mp2z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:22.989589 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:22.989548    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd podName:e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:26.989535336 +0000 UTC m=+10.152950370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv5jd" (UniqueName: "kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd") pod "network-check-target-mp2z5" (UID: "e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:23.340782 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:23.340750    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:23.340997 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:23.340888    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqhmn" podUID="b24d686f-e9ed-4920-af05-39519e7c35a0"
Sep 19 15:12:23.341380 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:23.341295    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:23.341468 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:23.341410    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:12:23.341468 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:23.341456    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:23.341584 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:23.341520    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp2z5" podUID="e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995"
Sep 19 15:12:25.340939 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:25.340408    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:25.340939 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:25.340461    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:25.340939 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:25.340416    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:25.340939 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:25.340546    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp2z5" podUID="e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995"
Sep 19 15:12:25.340939 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:25.340672    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:12:25.340939 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:25.340758    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqhmn" podUID="b24d686f-e9ed-4920-af05-39519e7c35a0"
Sep 19 15:12:26.922354 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:26.922312    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret\") pod \"global-pull-secret-syncer-gqhmn\" (UID: \"b24d686f-e9ed-4920-af05-39519e7c35a0\") " pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:26.923097 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:26.922382    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs\") pod \"network-metrics-daemon-tmbmf\" (UID: \"01ca12cf-99c7-4835-b150-0b653dfc1905\") " pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:26.923097 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:26.922497    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:26.923097 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:26.922535    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:26.923097 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:26.922585    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret podName:b24d686f-e9ed-4920-af05-39519e7c35a0 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:34.922560268 +0000 UTC m=+18.085975309 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret") pod "global-pull-secret-syncer-gqhmn" (UID: "b24d686f-e9ed-4920-af05-39519e7c35a0") : object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:26.923097 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:26.922610    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs podName:01ca12cf-99c7-4835-b150-0b653dfc1905 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:34.922598585 +0000 UTC m=+18.086013605 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs") pod "network-metrics-daemon-tmbmf" (UID: "01ca12cf-99c7-4835-b150-0b653dfc1905") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:27.022933 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:27.022899    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv5jd\" (UniqueName: \"kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd\") pod \"network-check-target-mp2z5\" (UID: \"e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995\") " pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:27.023111 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:27.023063    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 15:12:27.023111 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:27.023091    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 15:12:27.023111 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:27.023106    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tv5jd for pod openshift-network-diagnostics/network-check-target-mp2z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:27.023315 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:27.023184    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd podName:e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:35.023162676 +0000 UTC m=+18.186577717 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv5jd" (UniqueName: "kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd") pod "network-check-target-mp2z5" (UID: "e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:27.339228 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:27.339196    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:27.339391 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:27.339341    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqhmn" podUID="b24d686f-e9ed-4920-af05-39519e7c35a0"
Sep 19 15:12:27.339463 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:27.339394    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:27.339540 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:27.339508    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:27.339585 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:27.339526    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp2z5" podUID="e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995"
Sep 19 15:12:27.339639 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:27.339606    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:12:29.338260 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:29.338219    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:29.338708 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:29.338348    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqhmn" podUID="b24d686f-e9ed-4920-af05-39519e7c35a0"
Sep 19 15:12:29.338778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:29.338219    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:29.338871 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:29.338843    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp2z5" podUID="e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995"
Sep 19 15:12:29.338988 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:29.338931    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:29.339050 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:29.339004    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:12:31.338504 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:31.338477    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:31.338891 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:31.338477    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:31.338891 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:31.338583    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:12:31.338891 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:31.338477    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:31.338891 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:31.338656    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp2z5" podUID="e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995"
Sep 19 15:12:31.338891 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:31.338728    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqhmn" podUID="b24d686f-e9ed-4920-af05-39519e7c35a0"
Sep 19 15:12:33.339098 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:33.338592    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:33.339098 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:33.338624    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:33.339098 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:33.338624    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:33.339098 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:33.338714    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqhmn" podUID="b24d686f-e9ed-4920-af05-39519e7c35a0"
Sep 19 15:12:33.339098 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:33.338809    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:12:33.339098 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:33.338858    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp2z5" podUID="e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995"
Sep 19 15:12:34.982302 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:34.982273    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret\") pod \"global-pull-secret-syncer-gqhmn\" (UID: \"b24d686f-e9ed-4920-af05-39519e7c35a0\") " pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:34.982668 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:34.982313    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs\") pod \"network-metrics-daemon-tmbmf\" (UID: \"01ca12cf-99c7-4835-b150-0b653dfc1905\") " pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:34.982668 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:34.982407    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:34.982668 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:34.982408    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:34.982668 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:34.982454    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs podName:01ca12cf-99c7-4835-b150-0b653dfc1905 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:50.982440431 +0000 UTC m=+34.145855448 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs") pod "network-metrics-daemon-tmbmf" (UID: "01ca12cf-99c7-4835-b150-0b653dfc1905") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:34.982668 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:34.982466    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret podName:b24d686f-e9ed-4920-af05-39519e7c35a0 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:50.982461002 +0000 UTC m=+34.145876020 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret") pod "global-pull-secret-syncer-gqhmn" (UID: "b24d686f-e9ed-4920-af05-39519e7c35a0") : object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:35.082706 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:35.082680    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv5jd\" (UniqueName: \"kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd\") pod \"network-check-target-mp2z5\" (UID: \"e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995\") " pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:35.082817 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:35.082799    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 15:12:35.082817 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:35.082811    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 15:12:35.082895 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:35.082820    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tv5jd for pod openshift-network-diagnostics/network-check-target-mp2z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:35.082895 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:35.082857    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd podName:e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:51.082846597 +0000 UTC m=+34.246261615 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv5jd" (UniqueName: "kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd") pod "network-check-target-mp2z5" (UID: "e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:35.341378 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:35.341346    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:35.341508 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:35.341451    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp2z5" podUID="e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995"
Sep 19 15:12:35.341565 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:35.341518    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:35.341618 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:35.341602    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqhmn" podUID="b24d686f-e9ed-4920-af05-39519e7c35a0"
Sep 19 15:12:35.341660 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:35.341610    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:35.341706 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:35.341691    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:12:37.342151 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:37.342120    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:37.342529 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:37.342228    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:37.342529 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:37.342235    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:12:37.342529 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:37.342329    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp2z5" podUID="e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995"
Sep 19 15:12:37.342529 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:37.342373    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:37.342529 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:37.342422    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqhmn" podUID="b24d686f-e9ed-4920-af05-39519e7c35a0"
Sep 19 15:12:39.338245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.337907    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:39.338245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.338039    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:39.338245 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:39.338152    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:12:39.338245 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:39.338033    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp2z5" podUID="e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995"
Sep 19 15:12:39.338245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.338208    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:39.338830 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:39.338287    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqhmn" podUID="b24d686f-e9ed-4920-af05-39519e7c35a0"
Sep 19 15:12:39.484668 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.484507    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4xcgl" event={"ID":"c26f271f-4c0a-4303-963e-df1323fa4bec","Type":"ContainerStarted","Data":"7b9f9fbfea0c2e59f4356645f43103fa9d302ddab3d0b72adace8c4e6ea6b78e"}
Sep 19 15:12:39.486481 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.486450    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xzf7q" event={"ID":"6d52154d-1cc7-4041-a644-59b431ba759c","Type":"ContainerStarted","Data":"64fcf03d78779120ef4ceb26396dcc6da282aabfb73c150f0fa0bc97333a3df9"}
Sep 19 15:12:39.488739 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.488719    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-58r2q" event={"ID":"3aca63a0-9cfb-48b7-8427-459bf0649d60","Type":"ContainerStarted","Data":"dd84e53466fc3c5a38af7e9a0ac1269eec43f8cd1525d2742dc5ec69d64ec334"}
Sep 19 15:12:39.490384 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.490361    2562 generic.go:356] "Generic (PLEG): container finished" podID="1a4bb7a8-7c42-4d58-b35a-7e476a5f107d" containerID="77c178254aabe0e4a541d046be8d251d2becb6c40c1c1cd3d23a1b098caf8058" exitCode=0
Sep 19 15:12:39.490466 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.490453    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hp2zp" event={"ID":"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d","Type":"ContainerDied","Data":"77c178254aabe0e4a541d046be8d251d2becb6c40c1c1cd3d23a1b098caf8058"}
Sep 19 15:12:39.492252 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.492026    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-55xl9" event={"ID":"64d9e6c6-4c5e-4dbf-b313-48309f1fc05f","Type":"ContainerStarted","Data":"d22513613f379caceb193a6bbe435c3e389bfd66e27a961bb0ebe11e79d934c2"}
Sep 19 15:12:39.497122 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.497072    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4xcgl" podStartSLOduration=2.706289453 podStartE2EDuration="21.497035335s" totalImagesPullingTime="18.790745882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:39.496869719 +0000 UTC m=+22.660284764" watchObservedRunningTime="2026-09-19 15:12:39.497035335 +0000 UTC m=+22.660450366"
Sep 19 15:12:39.497357 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.497322    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal" podStartSLOduration=20.49730822 podStartE2EDuration="20.49730822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:22.458863316 +0000 UTC m=+5.622278361" watchObservedRunningTime="2026-09-19 15:12:39.49730822 +0000 UTC m=+22.660723261"
Sep 19 15:12:39.497632 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.497616    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t" event={"ID":"b9ca203c-13ed-409b-81de-e1e5bb26c0c3","Type":"ContainerStarted","Data":"a9024d758671eeb5f23e7ba36c62fb41070fa2a87155b3bf595b09c517e0ae85"}
Sep 19 15:12:39.497678 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.497667    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t" event={"ID":"b9ca203c-13ed-409b-81de-e1e5bb26c0c3","Type":"ContainerStarted","Data":"2bf6318758a6124b129128ed9faa3d5ab70ad59e92840c3be929afe4ebb9f539"}
Sep 19 15:12:39.499140 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.499117    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt" event={"ID":"3324dc82-9965-41c2-b650-33794d1a73fd","Type":"ContainerStarted","Data":"02eb6c1afd835f4b46425698e6615d2ccb6d9be370c0e750961b1a3e3f22f908"}
Sep 19 15:12:39.500344 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.500326    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gwcr6" event={"ID":"aa837c9f-9e43-4dec-a8ae-637125174f5d","Type":"ContainerStarted","Data":"d0245780fd33e024f8c01bb30043ba762d16a6280d3383d5b1b5f24a49875560"}
Sep 19 15:12:39.509095 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.509058    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xzf7q" podStartSLOduration=2.715492615 podStartE2EDuration="21.509046421s" totalImagesPullingTime="18.793553806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:39.508643049 +0000 UTC m=+22.672058088" watchObservedRunningTime="2026-09-19 15:12:39.509046421 +0000 UTC m=+22.672461461"
Sep 19 15:12:39.521490 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.521456    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-58r2q" podStartSLOduration=2.718126206 podStartE2EDuration="21.52144357s" totalImagesPullingTime="18.803317364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:39.521326885 +0000 UTC m=+22.684741926" watchObservedRunningTime="2026-09-19 15:12:39.52144357 +0000 UTC m=+22.684858612"
Sep 19 15:12:39.533299 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.533268    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-55xl9" podStartSLOduration=6.431550676 podStartE2EDuration="21.533255996s" totalImagesPullingTime="15.10170532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:39.533088483 +0000 UTC m=+22.696503522" watchObservedRunningTime="2026-09-19 15:12:39.533255996 +0000 UTC m=+22.696671028"
Sep 19 15:12:39.566069 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:39.566025    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gwcr6" podStartSLOduration=2.691825658 podStartE2EDuration="21.56601177s" totalImagesPullingTime="18.874186112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:39.565540621 +0000 UTC m=+22.728955662" watchObservedRunningTime="2026-09-19 15:12:39.56601177 +0000 UTC m=+22.729426810"
Sep 19 15:12:40.505826 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:40.505594    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t" event={"ID":"b9ca203c-13ed-409b-81de-e1e5bb26c0c3","Type":"ContainerStarted","Data":"95cca023329036dfaaea639a5d4424c1e90cad5fb67ca2a4aa2bca45ea414264"}
Sep 19 15:12:40.506665 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:40.505868    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t" event={"ID":"b9ca203c-13ed-409b-81de-e1e5bb26c0c3","Type":"ContainerStarted","Data":"236ceb1238743f5dadaa707bce04938ec75631251b35663ea8108a2a0606277a"}
Sep 19 15:12:40.506665 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:40.505923    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t" event={"ID":"b9ca203c-13ed-409b-81de-e1e5bb26c0c3","Type":"ContainerStarted","Data":"fdebdc7aeb6c9917ce1ebb9e20a3a24f960e74fbb90554128faae6af98bab155"}
Sep 19 15:12:40.506665 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:40.505968    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t" event={"ID":"b9ca203c-13ed-409b-81de-e1e5bb26c0c3","Type":"ContainerStarted","Data":"f5c88c95cf53817a965b8c538cd77f2663e3b41d9f199be9a38d6cfcaa22913b"}
Sep 19 15:12:40.774379 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:40.774354    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 19 15:12:41.183134 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:41.183106    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-55xl9"
Sep 19 15:12:41.183689 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:41.183673    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-55xl9"
Sep 19 15:12:41.317548 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:41.317450    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-19T15:12:40.774376171Z","UUID":"eb94d04b-4c41-417f-bf3e-811dca3e7f3e","Handler":null,"Name":"","Endpoint":""}
Sep 19 15:12:41.319021 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:41.319001    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 19 15:12:41.319155 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:41.319028    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 19 15:12:41.341597 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:41.341578    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:41.341701 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:41.341647    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:41.341766 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:41.341750    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:41.341816 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:41.341750    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp2z5" podUID="e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995"
Sep 19 15:12:41.341872 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:41.341851    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqhmn" podUID="b24d686f-e9ed-4920-af05-39519e7c35a0"
Sep 19 15:12:41.341983 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:41.341964    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:12:41.443056 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:41.442981    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:12:41.509724 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:41.509682    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7tvm7" event={"ID":"9c545239-bdd5-409d-a620-e5796fc516ba","Type":"ContainerStarted","Data":"d1ee9316263afe51b19f182bbd039116f9cf452c1cafcea2ce8b49dc078a4c23"}
Sep 19 15:12:41.512268 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:41.512187    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt" event={"ID":"3324dc82-9965-41c2-b650-33794d1a73fd","Type":"ContainerStarted","Data":"d3c09f0f7b45213d5a6cca6f1b38fda8942fb02b40721efc1476db3404b95077"}
Sep 19 15:12:41.512444 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:41.512412    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-55xl9"
Sep 19 15:12:41.512848 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:41.512811    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-55xl9"
Sep 19 15:12:41.523045 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:41.523003    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7tvm7" podStartSLOduration=4.744558394 podStartE2EDuration="23.522986079s" totalImagesPullingTime="18.778427685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:41.522774835 +0000 UTC m=+24.686189876" watchObservedRunningTime="2026-09-19 15:12:41.522986079 +0000 UTC m=+24.686401121"
Sep 19 15:12:41.641813 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:41.641780    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:12:41.742022 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:41.741949    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:12:42.391472 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:42.391438    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:12:42.517982 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:42.517948    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t" event={"ID":"b9ca203c-13ed-409b-81de-e1e5bb26c0c3","Type":"ContainerStarted","Data":"0e5ca2117f93b99735b2b1297b3cdb3eec3ede55f39c9270c1dcbccfafacaef9"}
Sep 19 15:12:42.520510 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:42.520484    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt" event={"ID":"3324dc82-9965-41c2-b650-33794d1a73fd","Type":"ContainerStarted","Data":"a8240c4482a855428ecf399f2e198f6d2106e24459848b86b50c81d986963b42"}
Sep 19 15:12:42.542096 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:42.542045    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl6dt" podStartSLOduration=7.264912831 podStartE2EDuration="24.54202823s" totalImagesPullingTime="17.277115399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:42.540936386 +0000 UTC m=+25.704351426" watchObservedRunningTime="2026-09-19 15:12:42.54202823 +0000 UTC m=+25.705443272"
Sep 19 15:12:42.758716 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:42.758642    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:12:42.860117 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:42.860086    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:12:43.341377 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:43.341344    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:43.341377 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:43.341374    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:43.341589 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:43.341443    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:43.341589 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:43.341459    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp2z5" podUID="e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995"
Sep 19 15:12:43.341589 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:43.341529    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:12:43.341705 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:43.341595    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqhmn" podUID="b24d686f-e9ed-4920-af05-39519e7c35a0"
Sep 19 15:12:44.840501 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:44.840331    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:12:44.928339 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:44.928296    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:12:45.338594 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:45.338571    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:45.338594 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:45.338589    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:45.338812 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:45.338571    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:45.338812 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:45.338671    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp2z5" podUID="e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995"
Sep 19 15:12:45.338812 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:45.338734    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:12:45.338812 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:45.338795    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqhmn" podUID="b24d686f-e9ed-4920-af05-39519e7c35a0"
Sep 19 15:12:45.528953 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:45.528920    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t" event={"ID":"b9ca203c-13ed-409b-81de-e1e5bb26c0c3","Type":"ContainerStarted","Data":"d15f1fcd69b05e19a81721ddb547c44b116f51bb1cae6a1a64865a0610ae66ec"}
Sep 19 15:12:45.529181 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:45.529166    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:45.530966 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:45.530946    2562 generic.go:356] "Generic (PLEG): container finished" podID="1a4bb7a8-7c42-4d58-b35a-7e476a5f107d" containerID="9062e9319e3c71cdfbc300ffa6685e8c9312614a3cef553ea8721fb1b1bf53a4" exitCode=0
Sep 19 15:12:45.531076 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:45.530980    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hp2zp" event={"ID":"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d","Type":"ContainerDied","Data":"9062e9319e3c71cdfbc300ffa6685e8c9312614a3cef553ea8721fb1b1bf53a4"}
Sep 19 15:12:45.544846 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:45.544828    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:45.576912 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:45.576874    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t" podStartSLOduration=8.739574432 podStartE2EDuration="27.576863536s" totalImagesPullingTime="18.837289104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:45.559833121 +0000 UTC m=+28.723248156" watchObservedRunningTime="2026-09-19 15:12:45.576863536 +0000 UTC m=+28.740278575"
Sep 19 15:12:46.051090 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:46.051049    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:12:46.151521 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:46.151490    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:12:46.384961 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:46.384806    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:12:46.535840 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:46.535812    2562 generic.go:356] "Generic (PLEG): container finished" podID="1a4bb7a8-7c42-4d58-b35a-7e476a5f107d" containerID="58f603cd285236a6cd2120db83c057f85de85f533f21d1fff74131a9913b21b0" exitCode=0
Sep 19 15:12:46.536024 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:46.535883    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hp2zp" event={"ID":"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d","Type":"ContainerDied","Data":"58f603cd285236a6cd2120db83c057f85de85f533f21d1fff74131a9913b21b0"}
Sep 19 15:12:46.536417 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:46.536399    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:46.536524 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:46.536473    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:46.554233 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:46.554153    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:12:46.559903 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:46.559882    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mp2z5"]
Sep 19 15:12:46.560037 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:46.560019    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:46.560167 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:46.560148    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp2z5" podUID="e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995"
Sep 19 15:12:46.560683 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:46.560658    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gqhmn"]
Sep 19 15:12:46.560807 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:46.560731    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:46.560807 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:46.560793    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqhmn" podUID="b24d686f-e9ed-4920-af05-39519e7c35a0"
Sep 19 15:12:46.561486 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:46.561464    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tmbmf"]
Sep 19 15:12:46.561590 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:46.561555    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:46.561661 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:46.561645    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:12:47.354553 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:47.354525    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a4bb7a8_7c42_4d58_b35a_7e476a5f107d.slice/crio-bc413f03eea23d1f58759f16ce2ce9816244fa8bd6c14d3cfac6ac5af0a43ea7.scope\": RecentStats: unable to find data in memory cache]"
Sep 19 15:12:47.540345 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:47.540318    2562 generic.go:356] "Generic (PLEG): container finished" podID="1a4bb7a8-7c42-4d58-b35a-7e476a5f107d" containerID="bc413f03eea23d1f58759f16ce2ce9816244fa8bd6c14d3cfac6ac5af0a43ea7" exitCode=0
Sep 19 15:12:47.540446 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:47.540406    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hp2zp" event={"ID":"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d","Type":"ContainerDied","Data":"bc413f03eea23d1f58759f16ce2ce9816244fa8bd6c14d3cfac6ac5af0a43ea7"}
Sep 19 15:12:48.338183 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:48.338152    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:48.338183 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:48.338167    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:48.338406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:48.338298    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:48.338406 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:48.338299    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp2z5" podUID="e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995"
Sep 19 15:12:48.338406 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:48.338382    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:12:48.338523 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:48.338455    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqhmn" podUID="b24d686f-e9ed-4920-af05-39519e7c35a0"
Sep 19 15:12:50.338744 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:50.338703    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:50.339142 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:50.338707    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:50.339142 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:50.338854    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:50.339142 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:50.338831    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqhmn" podUID="b24d686f-e9ed-4920-af05-39519e7c35a0"
Sep 19 15:12:50.339142 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:50.338975    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:12:50.339142 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:50.339068    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp2z5" podUID="e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995"
Sep 19 15:12:50.991770 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:50.991730    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs\") pod \"network-metrics-daemon-tmbmf\" (UID: \"01ca12cf-99c7-4835-b150-0b653dfc1905\") " pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:50.991969 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:50.991820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret\") pod \"global-pull-secret-syncer-gqhmn\" (UID: \"b24d686f-e9ed-4920-af05-39519e7c35a0\") " pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:50.991969 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:50.991928    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:50.991969 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:50.991876    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:50.992125 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:50.991989    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret podName:b24d686f-e9ed-4920-af05-39519e7c35a0 nodeName:}" failed. No retries permitted until 2026-09-19 15:13:22.991971124 +0000 UTC m=+66.155386143 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret") pod "global-pull-secret-syncer-gqhmn" (UID: "b24d686f-e9ed-4920-af05-39519e7c35a0") : object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:50.992125 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:50.992039    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs podName:01ca12cf-99c7-4835-b150-0b653dfc1905 nodeName:}" failed. No retries permitted until 2026-09-19 15:13:22.992008375 +0000 UTC m=+66.155423411 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs") pod "network-metrics-daemon-tmbmf" (UID: "01ca12cf-99c7-4835-b150-0b653dfc1905") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:51.093148 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:51.093109    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv5jd\" (UniqueName: \"kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd\") pod \"network-check-target-mp2z5\" (UID: \"e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995\") " pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:51.093373 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:51.093307    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 15:12:51.093373 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:51.093327    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 15:12:51.093373 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:51.093337    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tv5jd for pod openshift-network-diagnostics/network-check-target-mp2z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:51.093507 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:51.093394    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd podName:e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995 nodeName:}" failed. No retries permitted until 2026-09-19 15:13:23.093380566 +0000 UTC m=+66.256795597 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv5jd" (UniqueName: "kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd") pod "network-check-target-mp2z5" (UID: "e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:52.140613 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.140451    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeReady"
Sep 19 15:12:52.140900 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.140682    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 19 15:12:52.178102 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.178078    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-45sbs"]
Sep 19 15:12:52.190531 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.190511    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zdpzb"]
Sep 19 15:12:52.190709 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.190639    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-45sbs"
Sep 19 15:12:52.192640 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.192621    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 19 15:12:52.192764 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.192743    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 19 15:12:52.192861 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.192849    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p4wjr\""
Sep 19 15:12:52.212901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.212875    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-45sbs"]
Sep 19 15:12:52.212982 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.212925    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zdpzb"]
Sep 19 15:12:52.212982 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.212877    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zdpzb"
Sep 19 15:12:52.214796 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.214780    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 19 15:12:52.214962 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.214938    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 19 15:12:52.215076 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.215061    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 19 15:12:52.215165 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.215150    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v2755\""
Sep 19 15:12:52.299456 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.299433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/821b6690-fc9e-41c5-9cc7-78bd1c526f75-cert\") pod \"ingress-canary-zdpzb\" (UID: \"821b6690-fc9e-41c5-9cc7-78bd1c526f75\") " pod="openshift-ingress-canary/ingress-canary-zdpzb"
Sep 19 15:12:52.299578 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.299469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j2q6\" (UniqueName: \"kubernetes.io/projected/821b6690-fc9e-41c5-9cc7-78bd1c526f75-kube-api-access-8j2q6\") pod \"ingress-canary-zdpzb\" (UID: \"821b6690-fc9e-41c5-9cc7-78bd1c526f75\") " pod="openshift-ingress-canary/ingress-canary-zdpzb"
Sep 19 15:12:52.299578 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.299491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:12:52.299578 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.299514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36959d15-6f58-4b56-9dfc-be887a6f07b1-config-volume\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:12:52.299578 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.299533    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36959d15-6f58-4b56-9dfc-be887a6f07b1-tmp-dir\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:12:52.299578 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.299549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxzbj\" (UniqueName: \"kubernetes.io/projected/36959d15-6f58-4b56-9dfc-be887a6f07b1-kube-api-access-kxzbj\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:12:52.338809 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.338781    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:12:52.338898 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.338882    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:12:52.338993 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.338976    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:12:52.341112 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.341096    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 15:12:52.341318 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.341295    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fxxj8\""
Sep 19 15:12:52.341418 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.341343    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 15:12:52.341418 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.341394    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 15:12:52.341418 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.341405    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 15:12:52.341594 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.341350    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zprn6\""
Sep 19 15:12:52.400503 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.400480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j2q6\" (UniqueName: \"kubernetes.io/projected/821b6690-fc9e-41c5-9cc7-78bd1c526f75-kube-api-access-8j2q6\") pod \"ingress-canary-zdpzb\" (UID: \"821b6690-fc9e-41c5-9cc7-78bd1c526f75\") " pod="openshift-ingress-canary/ingress-canary-zdpzb"
Sep 19 15:12:52.400636 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.400519    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:12:52.400636 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.400551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36959d15-6f58-4b56-9dfc-be887a6f07b1-config-volume\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:12:52.400636 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.400568    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36959d15-6f58-4b56-9dfc-be887a6f07b1-tmp-dir\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:12:52.400636 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.400592    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxzbj\" (UniqueName: \"kubernetes.io/projected/36959d15-6f58-4b56-9dfc-be887a6f07b1-kube-api-access-kxzbj\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:12:52.400847 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.400682    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/821b6690-fc9e-41c5-9cc7-78bd1c526f75-cert\") pod \"ingress-canary-zdpzb\" (UID: \"821b6690-fc9e-41c5-9cc7-78bd1c526f75\") " pod="openshift-ingress-canary/ingress-canary-zdpzb"
Sep 19 15:12:52.400847 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:52.400686    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:12:52.400961 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:52.400888    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls podName:36959d15-6f58-4b56-9dfc-be887a6f07b1 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:52.900802271 +0000 UTC m=+36.064217290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls") pod "dns-default-45sbs" (UID: "36959d15-6f58-4b56-9dfc-be887a6f07b1") : secret "dns-default-metrics-tls" not found
Sep 19 15:12:52.401033 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.401006    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36959d15-6f58-4b56-9dfc-be887a6f07b1-tmp-dir\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:12:52.401262 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.401243    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36959d15-6f58-4b56-9dfc-be887a6f07b1-config-volume\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:12:52.405108 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.405080    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/821b6690-fc9e-41c5-9cc7-78bd1c526f75-cert\") pod \"ingress-canary-zdpzb\" (UID: \"821b6690-fc9e-41c5-9cc7-78bd1c526f75\") " pod="openshift-ingress-canary/ingress-canary-zdpzb"
Sep 19 15:12:52.408270 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.408248    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxzbj\" (UniqueName: \"kubernetes.io/projected/36959d15-6f58-4b56-9dfc-be887a6f07b1-kube-api-access-kxzbj\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:12:52.408401 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.408289    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j2q6\" (UniqueName: \"kubernetes.io/projected/821b6690-fc9e-41c5-9cc7-78bd1c526f75-kube-api-access-8j2q6\") pod \"ingress-canary-zdpzb\" (UID: \"821b6690-fc9e-41c5-9cc7-78bd1c526f75\") " pod="openshift-ingress-canary/ingress-canary-zdpzb"
Sep 19 15:12:52.521446 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.521409    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zdpzb"
Sep 19 15:12:52.556880 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.556857    2562 generic.go:356] "Generic (PLEG): container finished" podID="1a4bb7a8-7c42-4d58-b35a-7e476a5f107d" containerID="42660b3881f61026daea76333a8863eb93179a480d16aca00a24113f8372e389" exitCode=0
Sep 19 15:12:52.556964 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.556893    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hp2zp" event={"ID":"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d","Type":"ContainerDied","Data":"42660b3881f61026daea76333a8863eb93179a480d16aca00a24113f8372e389"}
Sep 19 15:12:52.827095 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.826885    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zdpzb"]
Sep 19 15:12:52.830439 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:12:52.830415    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod821b6690_fc9e_41c5_9cc7_78bd1c526f75.slice/crio-dd5d7cd19de191f849affbdbaae67d8487d482fca7b4e95a792a3fc49d225d58 WatchSource:0}: Error finding container dd5d7cd19de191f849affbdbaae67d8487d482fca7b4e95a792a3fc49d225d58: Status 404 returned error can't find the container with id dd5d7cd19de191f849affbdbaae67d8487d482fca7b4e95a792a3fc49d225d58
Sep 19 15:12:52.904495 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:52.904451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:12:52.904590 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:52.904565    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:12:52.904626 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:52.904612    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls podName:36959d15-6f58-4b56-9dfc-be887a6f07b1 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:53.904598542 +0000 UTC m=+37.068013560 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls") pod "dns-default-45sbs" (UID: "36959d15-6f58-4b56-9dfc-be887a6f07b1") : secret "dns-default-metrics-tls" not found
Sep 19 15:12:53.560365 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:53.560323    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zdpzb" event={"ID":"821b6690-fc9e-41c5-9cc7-78bd1c526f75","Type":"ContainerStarted","Data":"dd5d7cd19de191f849affbdbaae67d8487d482fca7b4e95a792a3fc49d225d58"}
Sep 19 15:12:53.564078 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:53.564042    2562 generic.go:356] "Generic (PLEG): container finished" podID="1a4bb7a8-7c42-4d58-b35a-7e476a5f107d" containerID="574b9fb28973e2988f282b3f1e5632866c7693f682551e13abe0fd32ccd9a141" exitCode=0
Sep 19 15:12:53.564078 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:53.564074    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hp2zp" event={"ID":"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d","Type":"ContainerDied","Data":"574b9fb28973e2988f282b3f1e5632866c7693f682551e13abe0fd32ccd9a141"}
Sep 19 15:12:53.912555 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:53.912467    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:12:53.912701 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:53.912621    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:12:53.912701 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:53.912683    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls podName:36959d15-6f58-4b56-9dfc-be887a6f07b1 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:55.912663117 +0000 UTC m=+39.076078151 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls") pod "dns-default-45sbs" (UID: "36959d15-6f58-4b56-9dfc-be887a6f07b1") : secret "dns-default-metrics-tls" not found
Sep 19 15:12:54.571350 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:54.571307    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hp2zp" event={"ID":"1a4bb7a8-7c42-4d58-b35a-7e476a5f107d","Type":"ContainerStarted","Data":"f4540642725c62d4d9985f068e3925b5f637cde1c128019da405efb581fc8f9a"}
Sep 19 15:12:54.595096 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:54.594117    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hp2zp" podStartSLOduration=6.468942381 podStartE2EDuration="36.594096857s" totalImagesPullingTime="30.125154476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:54.590617029 +0000 UTC m=+37.754032072" watchObservedRunningTime="2026-09-19 15:12:54.594096857 +0000 UTC m=+37.757511904"
Sep 19 15:12:54.709527 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:54.709489    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:12:54.809630 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:54.809580    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:12:55.575421 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:55.575328    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zdpzb" event={"ID":"821b6690-fc9e-41c5-9cc7-78bd1c526f75","Type":"ContainerStarted","Data":"b74bc60e7e7a6acac71359ef36d00dc188e6f2dc1e470a6de0faaa7ebb123bd5"}
Sep 19 15:12:55.589608 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:55.589565    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zdpzb" podStartSLOduration=1.133137213 podStartE2EDuration="3.589552281s" totalImagesPullingTime="2.456415068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:55.588445738 +0000 UTC m=+38.751860778" watchObservedRunningTime="2026-09-19 15:12:55.589552281 +0000 UTC m=+38.752967321"
Sep 19 15:12:55.928419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:55.928255    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:12:55.928419 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:55.928390    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:12:55.928658 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:55.928453    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls podName:36959d15-6f58-4b56-9dfc-be887a6f07b1 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:59.928436028 +0000 UTC m=+43.091851064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls") pod "dns-default-45sbs" (UID: "36959d15-6f58-4b56-9dfc-be887a6f07b1") : secret "dns-default-metrics-tls" not found
Sep 19 15:12:57.166939 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:57.166908    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:12:57.662539 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:57.662508    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:12:57.707116 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:57.707088    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:12:59.955140 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:12:59.955103    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:12:59.955527 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:59.955265    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:12:59.955527 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:12:59.955326    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls podName:36959d15-6f58-4b56-9dfc-be887a6f07b1 nodeName:}" failed. No retries permitted until 2026-09-19 15:13:07.955310161 +0000 UTC m=+51.118725183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls") pod "dns-default-45sbs" (UID: "36959d15-6f58-4b56-9dfc-be887a6f07b1") : secret "dns-default-metrics-tls" not found
Sep 19 15:13:00.443732 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:00.443689    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:13:00.492536 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:00.492513    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:13:00.544965 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:00.544941    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:13:07.029878 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:07.029837    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:13:07.077394 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:07.077365    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:13:08.007855 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:08.007828    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:13:08.008019 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:13:08.007952    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:13:08.008019 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:13:08.007997    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls podName:36959d15-6f58-4b56-9dfc-be887a6f07b1 nodeName:}" failed. No retries permitted until 2026-09-19 15:13:24.007984341 +0000 UTC m=+67.171399358 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls") pod "dns-default-45sbs" (UID: "36959d15-6f58-4b56-9dfc-be887a6f07b1") : secret "dns-default-metrics-tls" not found
Sep 19 15:13:18.554750 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:18.554716    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmb2t"
Sep 19 15:13:18.701897 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:18.701862    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:13:18.803333 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:18.803298    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:13:20.366048 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:20.366007    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:13:20.427683 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:20.427654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:13:20.480809 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:20.480782    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:13:21.610563 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:21.610509    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:13:21.660669 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:21.660636    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:13:23.003653 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:23.003614    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret\") pod \"global-pull-secret-syncer-gqhmn\" (UID: \"b24d686f-e9ed-4920-af05-39519e7c35a0\") " pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:13:23.004031 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:23.003660    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs\") pod \"network-metrics-daemon-tmbmf\" (UID: \"01ca12cf-99c7-4835-b150-0b653dfc1905\") " pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:13:23.006585 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:23.006562    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 15:13:23.006706 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:23.006604    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 15:13:23.014437 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:13:23.014421    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 19 15:13:23.014524 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:13:23.014511    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs podName:01ca12cf-99c7-4835-b150-0b653dfc1905 nodeName:}" failed. No retries permitted until 2026-09-19 15:14:27.014488738 +0000 UTC m=+130.177903777 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs") pod "network-metrics-daemon-tmbmf" (UID: "01ca12cf-99c7-4835-b150-0b653dfc1905") : secret "metrics-daemon-secret" not found
Sep 19 15:13:23.017807 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:23.017788    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b24d686f-e9ed-4920-af05-39519e7c35a0-original-pull-secret\") pod \"global-pull-secret-syncer-gqhmn\" (UID: \"b24d686f-e9ed-4920-af05-39519e7c35a0\") " pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:13:23.104397 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:23.104366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv5jd\" (UniqueName: \"kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd\") pod \"network-check-target-mp2z5\" (UID: \"e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995\") " pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:13:23.106426 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:23.106408    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 15:13:23.116861 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:23.116845    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 15:13:23.127728 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:23.127703    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv5jd\" (UniqueName: \"kubernetes.io/projected/e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995-kube-api-access-tv5jd\") pod \"network-check-target-mp2z5\" (UID: \"e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995\") " pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:13:23.251472 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:23.251447    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zprn6\""
Sep 19 15:13:23.255112 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:23.255073    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqhmn"
Sep 19 15:13:23.259149 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:23.259132    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:13:23.556098 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:23.556070    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gqhmn"]
Sep 19 15:13:23.559157 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:13:23.559128    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb24d686f_e9ed_4920_af05_39519e7c35a0.slice/crio-7e5ef108f5641dda3a7d2247972a96796925ebba92180d0a756b803433992949 WatchSource:0}: Error finding container 7e5ef108f5641dda3a7d2247972a96796925ebba92180d0a756b803433992949: Status 404 returned error can't find the container with id 7e5ef108f5641dda3a7d2247972a96796925ebba92180d0a756b803433992949
Sep 19 15:13:23.579405 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:23.579368    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mp2z5"]
Sep 19 15:13:23.582638 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:13:23.582613    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8fd3501_a1a9_4b52_aa65_0b1a9bdcd995.slice/crio-77eda87a8741aaf5e0eaafe69e17d048be428700c4748b7881d9ab8a6c6e2422 WatchSource:0}: Error finding container 77eda87a8741aaf5e0eaafe69e17d048be428700c4748b7881d9ab8a6c6e2422: Status 404 returned error can't find the container with id 77eda87a8741aaf5e0eaafe69e17d048be428700c4748b7881d9ab8a6c6e2422
Sep 19 15:13:23.638772 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:23.638749    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mp2z5" event={"ID":"e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995","Type":"ContainerStarted","Data":"77eda87a8741aaf5e0eaafe69e17d048be428700c4748b7881d9ab8a6c6e2422"}
Sep 19 15:13:23.639954 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:23.639906    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gqhmn" event={"ID":"b24d686f-e9ed-4920-af05-39519e7c35a0","Type":"ContainerStarted","Data":"7e5ef108f5641dda3a7d2247972a96796925ebba92180d0a756b803433992949"}
Sep 19 15:13:24.010421 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:24.010254    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:13:24.010421 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:13:24.010384    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:13:24.010882 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:13:24.010458    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls podName:36959d15-6f58-4b56-9dfc-be887a6f07b1 nodeName:}" failed. No retries permitted until 2026-09-19 15:13:56.010436107 +0000 UTC m=+99.173851138 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls") pod "dns-default-45sbs" (UID: "36959d15-6f58-4b56-9dfc-be887a6f07b1") : secret "dns-default-metrics-tls" not found
Sep 19 15:13:26.137158 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.137120    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8565c4f588-bxkmg"]
Sep 19 15:13:26.139078 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.139059    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8565c4f588-bxkmg"
Sep 19 15:13:26.141996 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.141974    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wqkc8\""
Sep 19 15:13:26.142104 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.142026    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 19 15:13:26.142104 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.141983    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 19 15:13:26.142613 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.142477    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 19 15:13:26.142613 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.142493    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 19 15:13:26.149823 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.149769    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8565c4f588-bxkmg"]
Sep 19 15:13:26.161676 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.161652    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"]
Sep 19 15:13:26.163396 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.163377    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"
Sep 19 15:13:26.165573 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.165553    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 19 15:13:26.175470 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.175443    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"]
Sep 19 15:13:26.226555 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.226526    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81291026-f3a2-4015-b311-f9311a54613b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8565c4f588-bxkmg\" (UID: \"81291026-f3a2-4015-b311-f9311a54613b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8565c4f588-bxkmg"
Sep 19 15:13:26.226732 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.226577    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlptv\" (UniqueName: \"kubernetes.io/projected/81291026-f3a2-4015-b311-f9311a54613b-kube-api-access-mlptv\") pod \"managed-serviceaccount-addon-agent-8565c4f588-bxkmg\" (UID: \"81291026-f3a2-4015-b311-f9311a54613b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8565c4f588-bxkmg"
Sep 19 15:13:26.327249 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.327216    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/93e4bd48-681c-48d7-b3cd-c331a371a535-klusterlet-config\") pod \"klusterlet-addon-workmgr-59d9b549d6-hk9s7\" (UID: \"93e4bd48-681c-48d7-b3cd-c331a371a535\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"
Sep 19 15:13:26.327437 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.327263    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81291026-f3a2-4015-b311-f9311a54613b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8565c4f588-bxkmg\" (UID: \"81291026-f3a2-4015-b311-f9311a54613b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8565c4f588-bxkmg"
Sep 19 15:13:26.327437 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.327289    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93e4bd48-681c-48d7-b3cd-c331a371a535-tmp\") pod \"klusterlet-addon-workmgr-59d9b549d6-hk9s7\" (UID: \"93e4bd48-681c-48d7-b3cd-c331a371a535\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"
Sep 19 15:13:26.327437 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.327380    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klsjk\" (UniqueName: \"kubernetes.io/projected/93e4bd48-681c-48d7-b3cd-c331a371a535-kube-api-access-klsjk\") pod \"klusterlet-addon-workmgr-59d9b549d6-hk9s7\" (UID: \"93e4bd48-681c-48d7-b3cd-c331a371a535\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"
Sep 19 15:13:26.327437 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.327431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlptv\" (UniqueName: \"kubernetes.io/projected/81291026-f3a2-4015-b311-f9311a54613b-kube-api-access-mlptv\") pod \"managed-serviceaccount-addon-agent-8565c4f588-bxkmg\" (UID: \"81291026-f3a2-4015-b311-f9311a54613b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8565c4f588-bxkmg"
Sep 19 15:13:26.330281 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.330259    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81291026-f3a2-4015-b311-f9311a54613b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8565c4f588-bxkmg\" (UID: \"81291026-f3a2-4015-b311-f9311a54613b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8565c4f588-bxkmg"
Sep 19 15:13:26.335305 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.335281    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlptv\" (UniqueName: \"kubernetes.io/projected/81291026-f3a2-4015-b311-f9311a54613b-kube-api-access-mlptv\") pod \"managed-serviceaccount-addon-agent-8565c4f588-bxkmg\" (UID: \"81291026-f3a2-4015-b311-f9311a54613b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8565c4f588-bxkmg"
Sep 19 15:13:26.428458 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.428370    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/93e4bd48-681c-48d7-b3cd-c331a371a535-klusterlet-config\") pod \"klusterlet-addon-workmgr-59d9b549d6-hk9s7\" (UID: \"93e4bd48-681c-48d7-b3cd-c331a371a535\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"
Sep 19 15:13:26.428458 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.428425    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93e4bd48-681c-48d7-b3cd-c331a371a535-tmp\") pod \"klusterlet-addon-workmgr-59d9b549d6-hk9s7\" (UID: \"93e4bd48-681c-48d7-b3cd-c331a371a535\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"
Sep 19 15:13:26.428690 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.428471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klsjk\" (UniqueName: \"kubernetes.io/projected/93e4bd48-681c-48d7-b3cd-c331a371a535-kube-api-access-klsjk\") pod \"klusterlet-addon-workmgr-59d9b549d6-hk9s7\" (UID: \"93e4bd48-681c-48d7-b3cd-c331a371a535\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"
Sep 19 15:13:26.429469 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.429433    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93e4bd48-681c-48d7-b3cd-c331a371a535-tmp\") pod \"klusterlet-addon-workmgr-59d9b549d6-hk9s7\" (UID: \"93e4bd48-681c-48d7-b3cd-c331a371a535\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"
Sep 19 15:13:26.431303 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.431282    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/93e4bd48-681c-48d7-b3cd-c331a371a535-klusterlet-config\") pod \"klusterlet-addon-workmgr-59d9b549d6-hk9s7\" (UID: \"93e4bd48-681c-48d7-b3cd-c331a371a535\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"
Sep 19 15:13:26.436214 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.436178    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klsjk\" (UniqueName: \"kubernetes.io/projected/93e4bd48-681c-48d7-b3cd-c331a371a535-kube-api-access-klsjk\") pod \"klusterlet-addon-workmgr-59d9b549d6-hk9s7\" (UID: \"93e4bd48-681c-48d7-b3cd-c331a371a535\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"
Sep 19 15:13:26.461016 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.460984    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8565c4f588-bxkmg"
Sep 19 15:13:26.473060 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:26.473038    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"
Sep 19 15:13:28.235104 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:28.235034    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"]
Sep 19 15:13:28.238108 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:28.237972    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8565c4f588-bxkmg"]
Sep 19 15:13:28.238980 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:13:28.238799    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e4bd48_681c_48d7_b3cd_c331a371a535.slice/crio-533a292562e65cb0298e0f7c39a46748036e5309092429151ba3a718784d6ecf WatchSource:0}: Error finding container 533a292562e65cb0298e0f7c39a46748036e5309092429151ba3a718784d6ecf: Status 404 returned error can't find the container with id 533a292562e65cb0298e0f7c39a46748036e5309092429151ba3a718784d6ecf
Sep 19 15:13:28.241650 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:13:28.241619    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81291026_f3a2_4015_b311_f9311a54613b.slice/crio-7e27593613fe03d477085955e4cedc5a50d939e0a5c545dcf9a005242c83267e WatchSource:0}: Error finding container 7e27593613fe03d477085955e4cedc5a50d939e0a5c545dcf9a005242c83267e: Status 404 returned error can't find the container with id 7e27593613fe03d477085955e4cedc5a50d939e0a5c545dcf9a005242c83267e
Sep 19 15:13:28.654888 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:28.654849    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gqhmn" event={"ID":"b24d686f-e9ed-4920-af05-39519e7c35a0","Type":"ContainerStarted","Data":"501524718fb802ecf30c65d484afe25b27dd96645560907329de1d2ef0e89ce6"}
Sep 19 15:13:28.656217 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:28.656176    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7" event={"ID":"93e4bd48-681c-48d7-b3cd-c331a371a535","Type":"ContainerStarted","Data":"533a292562e65cb0298e0f7c39a46748036e5309092429151ba3a718784d6ecf"}
Sep 19 15:13:28.657905 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:28.657875    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mp2z5" event={"ID":"e8fd3501-a1a9-4b52-aa65-0b1a9bdcd995","Type":"ContainerStarted","Data":"2c065b9fcd88bf247e1d1da0d7013fced007149c52e390484946c5939f3d9d31"}
Sep 19 15:13:28.658035 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:28.657924    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:13:28.659354 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:28.659326    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8565c4f588-bxkmg" event={"ID":"81291026-f3a2-4015-b311-f9311a54613b","Type":"ContainerStarted","Data":"7e27593613fe03d477085955e4cedc5a50d939e0a5c545dcf9a005242c83267e"}
Sep 19 15:13:28.669694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:28.669648    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gqhmn" podStartSLOduration=66.241983028 podStartE2EDuration="1m10.66963354s" totalImagesPullingTime="4.427650512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:13:28.669051597 +0000 UTC m=+71.832466641" watchObservedRunningTime="2026-09-19 15:13:28.66963354 +0000 UTC m=+71.833048579"
Sep 19 15:13:28.683080 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:28.683030    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mp2z5" podStartSLOduration=66.288126857 podStartE2EDuration="1m10.68301593s" totalImagesPullingTime="4.394889073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:13:28.682167655 +0000 UTC m=+71.845582695" watchObservedRunningTime="2026-09-19 15:13:28.68301593 +0000 UTC m=+71.846430961"
Sep 19 15:13:52.717575 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:52.717538    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8565c4f588-bxkmg" event={"ID":"81291026-f3a2-4015-b311-f9311a54613b","Type":"ContainerStarted","Data":"f69d9564492a254eb9491b701bd5c970a888e8513525eb55227da2852f9b3504"}
Sep 19 15:13:52.731462 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:52.731418    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8565c4f588-bxkmg" podStartSLOduration=3.164794067 podStartE2EDuration="26.731403153s" totalImagesPullingTime="23.566609086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:13:52.730417163 +0000 UTC m=+95.893832203" watchObservedRunningTime="2026-09-19 15:13:52.731403153 +0000 UTC m=+95.894818195"
Sep 19 15:13:56.016326 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:56.016292    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:13:56.016707 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:13:56.016401    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:13:56.016707 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:13:56.016454    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls podName:36959d15-6f58-4b56-9dfc-be887a6f07b1 nodeName:}" failed. No retries permitted until 2026-09-19 15:15:00.016441215 +0000 UTC m=+163.179856233 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls") pod "dns-default-45sbs" (UID: "36959d15-6f58-4b56-9dfc-be887a6f07b1") : secret "dns-default-metrics-tls" not found
Sep 19 15:13:58.733962 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:58.733915    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7" event={"ID":"93e4bd48-681c-48d7-b3cd-c331a371a535","Type":"ContainerStarted","Data":"0bce6905aff61331192d065768f8ea0262e8dfe63bfe3e506f6dc80d8a591d9b"}
Sep 19 15:13:58.734454 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:58.734143    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"
Sep 19 15:13:58.735899 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:58.735876    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"
Sep 19 15:13:58.748623 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:58.748574    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7" podStartSLOduration=2.771425644 podStartE2EDuration="32.748561249s" totalImagesPullingTime="29.977135605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:13:58.747771251 +0000 UTC m=+101.911186309" watchObservedRunningTime="2026-09-19 15:13:58.748561249 +0000 UTC m=+101.911976289"
Sep 19 15:13:59.663613 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:13:59.663588    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mp2z5"
Sep 19 15:14:27.113597 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:14:27.113545    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs\") pod \"network-metrics-daemon-tmbmf\" (UID: \"01ca12cf-99c7-4835-b150-0b653dfc1905\") " pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:14:27.114036 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:14:27.113706    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 19 15:14:27.114036 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:14:27.113786    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs podName:01ca12cf-99c7-4835-b150-0b653dfc1905 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:29.113768556 +0000 UTC m=+252.277183574 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs") pod "network-metrics-daemon-tmbmf" (UID: "01ca12cf-99c7-4835-b150-0b653dfc1905") : secret "metrics-daemon-secret" not found
Sep 19 15:14:55.200783 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:14:55.200738    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-45sbs" podUID="36959d15-6f58-4b56-9dfc-be887a6f07b1"
Sep 19 15:14:55.360244 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:14:55.360210    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:14:55.879683 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:14:55.879655    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-45sbs"
Sep 19 15:15:00.019744 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:15:00.019700    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:15:00.020145 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:15:00.019830    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:15:00.020145 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:15:00.019885    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls podName:36959d15-6f58-4b56-9dfc-be887a6f07b1 nodeName:}" failed. No retries permitted until 2026-09-19 15:17:02.019869288 +0000 UTC m=+285.183284319 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls") pod "dns-default-45sbs" (UID: "36959d15-6f58-4b56-9dfc-be887a6f07b1") : secret "dns-default-metrics-tls" not found
Sep 19 15:15:08.338361 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:15:08.338317    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:15:50.156429 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:15:50.156398    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:15:52.023890 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:15:52.023858    2562 generic.go:356] "Generic (PLEG): container finished" podID="81291026-f3a2-4015-b311-f9311a54613b" containerID="f69d9564492a254eb9491b701bd5c970a888e8513525eb55227da2852f9b3504" exitCode=255
Sep 19 15:15:52.024277 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:15:52.023940    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8565c4f588-bxkmg" event={"ID":"81291026-f3a2-4015-b311-f9311a54613b","Type":"ContainerDied","Data":"f69d9564492a254eb9491b701bd5c970a888e8513525eb55227da2852f9b3504"}
Sep 19 15:15:52.029265 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:15:52.029249    2562 scope.go:117] "RemoveContainer" containerID="f69d9564492a254eb9491b701bd5c970a888e8513525eb55227da2852f9b3504"
Sep 19 15:15:53.028782 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:15:53.028749    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8565c4f588-bxkmg" event={"ID":"81291026-f3a2-4015-b311-f9311a54613b","Type":"ContainerStarted","Data":"0c86144b1127c4272b1c6361bceff8affbd52eeeacfb4b2711ada7b5fde714a6"}
Sep 19 15:15:58.735424 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:15:58.735311    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7" podUID="93e4bd48-681c-48d7-b3cd-c331a371a535" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused"
Sep 19 15:15:59.049405 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:15:59.049360    2562 generic.go:356] "Generic (PLEG): container finished" podID="93e4bd48-681c-48d7-b3cd-c331a371a535" containerID="0bce6905aff61331192d065768f8ea0262e8dfe63bfe3e506f6dc80d8a591d9b" exitCode=1
Sep 19 15:15:59.049563 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:15:59.049440    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7" event={"ID":"93e4bd48-681c-48d7-b3cd-c331a371a535","Type":"ContainerDied","Data":"0bce6905aff61331192d065768f8ea0262e8dfe63bfe3e506f6dc80d8a591d9b"}
Sep 19 15:15:59.049763 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:15:59.049749    2562 scope.go:117] "RemoveContainer" containerID="0bce6905aff61331192d065768f8ea0262e8dfe63bfe3e506f6dc80d8a591d9b"
Sep 19 15:16:00.054505 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:00.054469    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7" event={"ID":"93e4bd48-681c-48d7-b3cd-c331a371a535","Type":"ContainerStarted","Data":"cb3ba53004163a30a6dcb31788016b337c798e7130b760dff8b2298809ee554f"}
Sep 19 15:16:00.054908 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:00.054767    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"
Sep 19 15:16:00.055369 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:00.055342    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9b549d6-hk9s7"
Sep 19 15:16:14.554875 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.554839    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-gmg87"]
Sep 19 15:16:14.557546 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.557524    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj"]
Sep 19 15:16:14.557678 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.557649    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gmg87"
Sep 19 15:16:14.560406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.560139    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj"
Sep 19 15:16:14.560809 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.560789    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-cdf4k\""
Sep 19 15:16:14.561097 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.561078    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b7d5bc959-97rck"]
Sep 19 15:16:14.562369 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.562350    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-c9fb5\""
Sep 19 15:16:14.562479 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.562420    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 19 15:16:14.562479 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.562452    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 19 15:16:14.562573 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.562494    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 19 15:16:14.562573 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.562563    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 19 15:16:14.563699 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.563679    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.566353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.566331    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 19 15:16:14.566650 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.566629    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 19 15:16:14.566768 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.566629    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xbxpb\""
Sep 19 15:16:14.566950 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.566931    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 19 15:16:14.567577 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.567557    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-gmg87"]
Sep 19 15:16:14.570464 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.570443    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj"]
Sep 19 15:16:14.571739 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.571686    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 19 15:16:14.578542 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.578520    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b7d5bc959-97rck"]
Sep 19 15:16:14.693043 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.693014    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:14.702097 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.702075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-installation-pull-secrets\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.702162 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.702106    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dv4z\" (UniqueName: \"kubernetes.io/projected/c627aa6f-7b3d-4043-92ab-509c93aeb0bc-kube-api-access-9dv4z\") pod \"network-check-source-7cbc45fddc-gmg87\" (UID: \"c627aa6f-7b3d-4043-92ab-509c93aeb0bc\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gmg87"
Sep 19 15:16:14.702162 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.702123    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36c16f0e-c336-42e7-a0c4-017c64d092c1-serving-cert\") pod \"service-ca-operator-57cdc4b768-4gdqj\" (UID: \"36c16f0e-c336-42e7-a0c4-017c64d092c1\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj"
Sep 19 15:16:14.702162 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.702142    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr48l\" (UniqueName: \"kubernetes.io/projected/36c16f0e-c336-42e7-a0c4-017c64d092c1-kube-api-access-rr48l\") pod \"service-ca-operator-57cdc4b768-4gdqj\" (UID: \"36c16f0e-c336-42e7-a0c4-017c64d092c1\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj"
Sep 19 15:16:14.702309 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.702166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-bound-sa-token\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.702309 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.702209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjl8f\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-kube-api-access-wjl8f\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.702309 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.702235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-certificates\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.702309 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.702268    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.702309 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.702286    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-image-registry-private-configuration\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.702309 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.702302    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-ca-trust-extracted\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.702536 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.702326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-trusted-ca\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.702536 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.702410    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36c16f0e-c336-42e7-a0c4-017c64d092c1-config\") pod \"service-ca-operator-57cdc4b768-4gdqj\" (UID: \"36c16f0e-c336-42e7-a0c4-017c64d092c1\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj"
Sep 19 15:16:14.745910 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.745884    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:14.802936 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.802912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-ca-trust-extracted\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.802936 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.802936    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-trusted-ca\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.803066 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.802960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36c16f0e-c336-42e7-a0c4-017c64d092c1-config\") pod \"service-ca-operator-57cdc4b768-4gdqj\" (UID: \"36c16f0e-c336-42e7-a0c4-017c64d092c1\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj"
Sep 19 15:16:14.803129 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.803103    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-installation-pull-secrets\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.803184 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.803158    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dv4z\" (UniqueName: \"kubernetes.io/projected/c627aa6f-7b3d-4043-92ab-509c93aeb0bc-kube-api-access-9dv4z\") pod \"network-check-source-7cbc45fddc-gmg87\" (UID: \"c627aa6f-7b3d-4043-92ab-509c93aeb0bc\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gmg87"
Sep 19 15:16:14.803261 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.803213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36c16f0e-c336-42e7-a0c4-017c64d092c1-serving-cert\") pod \"service-ca-operator-57cdc4b768-4gdqj\" (UID: \"36c16f0e-c336-42e7-a0c4-017c64d092c1\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj"
Sep 19 15:16:14.803261 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.803244    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr48l\" (UniqueName: \"kubernetes.io/projected/36c16f0e-c336-42e7-a0c4-017c64d092c1-kube-api-access-rr48l\") pod \"service-ca-operator-57cdc4b768-4gdqj\" (UID: \"36c16f0e-c336-42e7-a0c4-017c64d092c1\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj"
Sep 19 15:16:14.803353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.803270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-bound-sa-token\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.803353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.803322    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-ca-trust-extracted\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.803353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.803318    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjl8f\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-kube-api-access-wjl8f\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.803493 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.803380    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-certificates\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.803493 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.803418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.803493 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.803455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-image-registry-private-configuration\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.803648 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:14.803562    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 15:16:14.803648 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:14.803578    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7d5bc959-97rck: secret "image-registry-tls" not found
Sep 19 15:16:14.803648 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:14.803646    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls podName:5739e99a-2d54-4d00-bd3e-a9c3df7216dd nodeName:}" failed. No retries permitted until 2026-09-19 15:16:15.303626513 +0000 UTC m=+238.467041546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls") pod "image-registry-b7d5bc959-97rck" (UID: "5739e99a-2d54-4d00-bd3e-a9c3df7216dd") : secret "image-registry-tls" not found
Sep 19 15:16:14.804018 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.803991    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-certificates\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.804330 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.804306    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36c16f0e-c336-42e7-a0c4-017c64d092c1-config\") pod \"service-ca-operator-57cdc4b768-4gdqj\" (UID: \"36c16f0e-c336-42e7-a0c4-017c64d092c1\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj"
Sep 19 15:16:14.804722 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.804697    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-trusted-ca\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.805612 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.805571    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-installation-pull-secrets\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.805904 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.805884    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36c16f0e-c336-42e7-a0c4-017c64d092c1-serving-cert\") pod \"service-ca-operator-57cdc4b768-4gdqj\" (UID: \"36c16f0e-c336-42e7-a0c4-017c64d092c1\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj"
Sep 19 15:16:14.806026 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.806009    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-image-registry-private-configuration\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.811680 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.811657    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjl8f\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-kube-api-access-wjl8f\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.811796 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.811685    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dv4z\" (UniqueName: \"kubernetes.io/projected/c627aa6f-7b3d-4043-92ab-509c93aeb0bc-kube-api-access-9dv4z\") pod \"network-check-source-7cbc45fddc-gmg87\" (UID: \"c627aa6f-7b3d-4043-92ab-509c93aeb0bc\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gmg87"
Sep 19 15:16:14.811929 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.811907    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-bound-sa-token\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:14.812001 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.811949    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr48l\" (UniqueName: \"kubernetes.io/projected/36c16f0e-c336-42e7-a0c4-017c64d092c1-kube-api-access-rr48l\") pod \"service-ca-operator-57cdc4b768-4gdqj\" (UID: \"36c16f0e-c336-42e7-a0c4-017c64d092c1\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj"
Sep 19 15:16:14.869127 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.869105    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gmg87"
Sep 19 15:16:14.876126 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:14.876107    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj"
Sep 19 15:16:15.136751 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:15.136671    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-gmg87"]
Sep 19 15:16:15.140907 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:16:15.140885    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc627aa6f_7b3d_4043_92ab_509c93aeb0bc.slice/crio-55117b858e09a5fa19eb72080c40cf304b5d321a133379d53dcc251c831d397d WatchSource:0}: Error finding container 55117b858e09a5fa19eb72080c40cf304b5d321a133379d53dcc251c831d397d: Status 404 returned error can't find the container with id 55117b858e09a5fa19eb72080c40cf304b5d321a133379d53dcc251c831d397d
Sep 19 15:16:15.142954 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:15.142934    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj"]
Sep 19 15:16:15.145449 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:16:15.145429    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c16f0e_c336_42e7_a0c4_017c64d092c1.slice/crio-55b827d153bce6e5d027b42305c6768ea787357f47998c51a3696a0b04e11542 WatchSource:0}: Error finding container 55b827d153bce6e5d027b42305c6768ea787357f47998c51a3696a0b04e11542: Status 404 returned error can't find the container with id 55b827d153bce6e5d027b42305c6768ea787357f47998c51a3696a0b04e11542
Sep 19 15:16:15.307797 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:15.307754    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:15.307999 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:15.307921    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 15:16:15.307999 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:15.307943    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7d5bc959-97rck: secret "image-registry-tls" not found
Sep 19 15:16:15.308098 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:15.308016    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls podName:5739e99a-2d54-4d00-bd3e-a9c3df7216dd nodeName:}" failed. No retries permitted until 2026-09-19 15:16:16.307990648 +0000 UTC m=+239.471405670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls") pod "image-registry-b7d5bc959-97rck" (UID: "5739e99a-2d54-4d00-bd3e-a9c3df7216dd") : secret "image-registry-tls" not found
Sep 19 15:16:16.103324 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:16.103286    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gmg87" event={"ID":"c627aa6f-7b3d-4043-92ab-509c93aeb0bc","Type":"ContainerStarted","Data":"d850e68093c79e05a17617638e900c454184bae075fa116efea2127dd7cb6ffb"}
Sep 19 15:16:16.103753 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:16.103349    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gmg87" event={"ID":"c627aa6f-7b3d-4043-92ab-509c93aeb0bc","Type":"ContainerStarted","Data":"55117b858e09a5fa19eb72080c40cf304b5d321a133379d53dcc251c831d397d"}
Sep 19 15:16:16.104915 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:16.104891    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj" event={"ID":"36c16f0e-c336-42e7-a0c4-017c64d092c1","Type":"ContainerStarted","Data":"55b827d153bce6e5d027b42305c6768ea787357f47998c51a3696a0b04e11542"}
Sep 19 15:16:16.118549 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:16.118503    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gmg87" podStartSLOduration=2.118486023 podStartE2EDuration="2.118486023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:16:16.116930696 +0000 UTC m=+239.280345738" watchObservedRunningTime="2026-09-19 15:16:16.118486023 +0000 UTC m=+239.281901065"
Sep 19 15:16:16.314213 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:16.314158    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:16.314379 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:16.314320    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 15:16:16.314379 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:16.314338    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7d5bc959-97rck: secret "image-registry-tls" not found
Sep 19 15:16:16.314483 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:16.314400    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls podName:5739e99a-2d54-4d00-bd3e-a9c3df7216dd nodeName:}" failed. No retries permitted until 2026-09-19 15:16:18.314380098 +0000 UTC m=+241.477795115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls") pod "image-registry-b7d5bc959-97rck" (UID: "5739e99a-2d54-4d00-bd3e-a9c3df7216dd") : secret "image-registry-tls" not found
Sep 19 15:16:17.109793 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:17.109758    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj" event={"ID":"36c16f0e-c336-42e7-a0c4-017c64d092c1","Type":"ContainerStarted","Data":"dd617b897fa7de4f356f6d8ce4916034434163c6367714065d4ef28ee94ce507"}
Sep 19 15:16:17.124180 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:17.124129    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj" podStartSLOduration=1.243648601 podStartE2EDuration="3.12411288s" totalImagesPullingTime="1.880464279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:16:17.122712555 +0000 UTC m=+240.286127594" watchObservedRunningTime="2026-09-19 15:16:17.12411288 +0000 UTC m=+240.287527950"
Sep 19 15:16:18.326767 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:18.326730    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:18.327243 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:18.326828    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 15:16:18.327243 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:18.326838    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7d5bc959-97rck: secret "image-registry-tls" not found
Sep 19 15:16:18.327243 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:18.326882    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls podName:5739e99a-2d54-4d00-bd3e-a9c3df7216dd nodeName:}" failed. No retries permitted until 2026-09-19 15:16:22.326870074 +0000 UTC m=+245.490285091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls") pod "image-registry-b7d5bc959-97rck" (UID: "5739e99a-2d54-4d00-bd3e-a9c3df7216dd") : secret "image-registry-tls" not found
Sep 19 15:16:18.540189 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:18.540158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:18.641254 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:18.641165    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:18.740976 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:18.740950    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:18.842458 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:18.842433    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:19.155945 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:19.155917    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:19.204466 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:19.204443    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:19.442902 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:19.442848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:19.494365 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:19.494337    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:19.684917 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:19.684894    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:19.775281 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:19.775188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:19.869561 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:19.869534    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:19.880098 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:19.880069    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xwbp8"]
Sep 19 15:16:19.883336 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:19.883320    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:19.885581 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:19.885562    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tkfcq\""
Sep 19 15:16:19.885712 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:19.885688    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 19 15:16:19.885712 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:19.885710    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 19 15:16:19.886318 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:19.886304    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 19 15:16:19.886369 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:19.886307    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 19 15:16:19.891537 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:19.891518    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xwbp8"]
Sep 19 15:16:19.929494 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:19.929463    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:20.039590 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:20.039568    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5c930f9c-df8e-4bcb-bd9a-c056107829a0-crio-socket\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:20.039710 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:20.039600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:20.039710 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:20.039627    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:20.039710 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:20.039684    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c930f9c-df8e-4bcb-bd9a-c056107829a0-data-volume\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:20.039863 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:20.039779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chx7c\" (UniqueName: \"kubernetes.io/projected/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-api-access-chx7c\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:20.140264 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:20.140240    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5c930f9c-df8e-4bcb-bd9a-c056107829a0-crio-socket\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:20.140391 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:20.140276    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:20.140391 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:20.140315    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:20.140391 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:20.140353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c930f9c-df8e-4bcb-bd9a-c056107829a0-data-volume\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:20.140391 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:20.140355    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5c930f9c-df8e-4bcb-bd9a-c056107829a0-crio-socket\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:20.140391 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:20.140382    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chx7c\" (UniqueName: \"kubernetes.io/projected/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-api-access-chx7c\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:20.140391 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:20.140390    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:20.140666 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:20.140416    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 15:16:20.140666 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:20.140447    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls podName:5c930f9c-df8e-4bcb-bd9a-c056107829a0 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:20.640427981 +0000 UTC m=+243.803843000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xwbp8" (UID: "5c930f9c-df8e-4bcb-bd9a-c056107829a0") : secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:20.140666 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:20.140468    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm podName:5c930f9c-df8e-4bcb-bd9a-c056107829a0 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:20.640457488 +0000 UTC m=+243.803872512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xwbp8" (UID: "5c930f9c-df8e-4bcb-bd9a-c056107829a0") : configmap "kube-rbac-proxy" not found
Sep 19 15:16:20.140666 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:20.140631    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c930f9c-df8e-4bcb-bd9a-c056107829a0-data-volume\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:20.148398 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:20.148377    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chx7c\" (UniqueName: \"kubernetes.io/projected/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-api-access-chx7c\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:20.644573 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:20.644543    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:20.644962 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:20.644587    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:20.644962 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:20.644680    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 15:16:20.644962 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:20.644724    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:20.644962 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:20.644746    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm podName:5c930f9c-df8e-4bcb-bd9a-c056107829a0 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:21.64473031 +0000 UTC m=+244.808145327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xwbp8" (UID: "5c930f9c-df8e-4bcb-bd9a-c056107829a0") : configmap "kube-rbac-proxy" not found
Sep 19 15:16:20.644962 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:20.644828    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls podName:5c930f9c-df8e-4bcb-bd9a-c056107829a0 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:21.644811023 +0000 UTC m=+244.808226122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xwbp8" (UID: "5c930f9c-df8e-4bcb-bd9a-c056107829a0") : secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:21.053143 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:21.053112    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:21.097536 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:21.097511    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:21.651124 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:21.651092    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:21.651517 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:21.651133    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:21.651517 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:21.651233    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 15:16:21.651517 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:21.651259    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:21.651517 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:21.651297    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm podName:5c930f9c-df8e-4bcb-bd9a-c056107829a0 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:23.651283478 +0000 UTC m=+246.814698496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xwbp8" (UID: "5c930f9c-df8e-4bcb-bd9a-c056107829a0") : configmap "kube-rbac-proxy" not found
Sep 19 15:16:21.651517 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:21.651334    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls podName:5c930f9c-df8e-4bcb-bd9a-c056107829a0 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:23.651320357 +0000 UTC m=+246.814735463 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xwbp8" (UID: "5c930f9c-df8e-4bcb-bd9a-c056107829a0") : secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:21.866955 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:21.866928    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:22.356779 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:22.356752    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:22.356951 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:22.356867    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 15:16:22.356951 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:22.356878    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7d5bc959-97rck: secret "image-registry-tls" not found
Sep 19 15:16:22.356951 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:22.356928    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls podName:5739e99a-2d54-4d00-bd3e-a9c3df7216dd nodeName:}" failed. No retries permitted until 2026-09-19 15:16:30.35691506 +0000 UTC m=+253.520330078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls") pod "image-registry-b7d5bc959-97rck" (UID: "5739e99a-2d54-4d00-bd3e-a9c3df7216dd") : secret "image-registry-tls" not found
Sep 19 15:16:22.443704 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:22.443681    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4xcgl_c26f271f-4c0a-4303-963e-df1323fa4bec/dns-node-resolver/0.log"
Sep 19 15:16:23.667361 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:23.667327    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:23.667868 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:23.667379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:23.667868 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:23.667491    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:23.667868 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:23.667511    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 15:16:23.667868 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:23.667559    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls podName:5c930f9c-df8e-4bcb-bd9a-c056107829a0 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:27.667543342 +0000 UTC m=+250.830958364 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xwbp8" (UID: "5c930f9c-df8e-4bcb-bd9a-c056107829a0") : secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:23.667868 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:23.667576    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm podName:5c930f9c-df8e-4bcb-bd9a-c056107829a0 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:27.667570008 +0000 UTC m=+250.830985026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xwbp8" (UID: "5c930f9c-df8e-4bcb-bd9a-c056107829a0") : configmap "kube-rbac-proxy" not found
Sep 19 15:16:23.844330 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:23.844306    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xzf7q_6d52154d-1cc7-4041-a644-59b431ba759c/node-ca/0.log"
Sep 19 15:16:24.228515 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:24.228483    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:24.491413 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:24.491324    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:24.644135 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:24.644106    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zdpzb_821b6690-fc9e-41c5-9cc7-78bd1c526f75/serve-healthcheck-canary/0.log"
Sep 19 15:16:24.714178 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:24.714147    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:24.811272 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:24.811245    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:24.873823 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:24.873799    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:25.386559 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:25.386535    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:25.988502 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:25.988472    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:26.383177 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:26.383146    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:26.790610 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:26.790579    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:27.185681 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:27.185597    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:27.387335 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:27.387308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:27.695233 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:27.695175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:27.695392 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:27.695253    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:27.695392 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:27.695337    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:27.695392 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:27.695373    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 15:16:27.695511 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:27.695417    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls podName:5c930f9c-df8e-4bcb-bd9a-c056107829a0 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:35.69539807 +0000 UTC m=+258.858813134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xwbp8" (UID: "5c930f9c-df8e-4bcb-bd9a-c056107829a0") : secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:27.695511 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:27.695444    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm podName:5c930f9c-df8e-4bcb-bd9a-c056107829a0 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:35.69542904 +0000 UTC m=+258.858844063 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xwbp8" (UID: "5c930f9c-df8e-4bcb-bd9a-c056107829a0") : configmap "kube-rbac-proxy" not found
Sep 19 15:16:27.801251 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:27.801226    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:28.371121 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:28.371089    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:28.471142 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:28.471116    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:28.525654 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:28.525631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:28.990473 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:28.990441    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:29.179546 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:29.179517    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:29.204870 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:29.204842    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs\") pod \"network-metrics-daemon-tmbmf\" (UID: \"01ca12cf-99c7-4835-b150-0b653dfc1905\") " pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:16:29.204996 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:29.204985    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 19 15:16:29.205052 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:29.205041    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs podName:01ca12cf-99c7-4835-b150-0b653dfc1905 nodeName:}" failed. No retries permitted until 2026-09-19 15:18:31.205027271 +0000 UTC m=+374.368442288 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs") pod "network-metrics-daemon-tmbmf" (UID: "01ca12cf-99c7-4835-b150-0b653dfc1905") : secret "metrics-daemon-secret" not found
Sep 19 15:16:29.585805 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:29.585774    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:29.787114 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:29.787083    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:30.182762 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:30.182732    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:30.412832 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:30.412806    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:30.415480 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:30.415459    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls\") pod \"image-registry-b7d5bc959-97rck\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") " pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:30.484564 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:30.484499    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xbxpb\""
Sep 19 15:16:30.493139 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:30.493119    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:30.771647 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:30.771579    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b7d5bc959-97rck"]
Sep 19 15:16:30.774103 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:16:30.774074    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5739e99a_2d54_4d00_bd3e_a9c3df7216dd.slice/crio-eca058a08f8454377e130194ee5c35ae09500f7dcda97b751d1e065a38dfb8cf WatchSource:0}: Error finding container eca058a08f8454377e130194ee5c35ae09500f7dcda97b751d1e065a38dfb8cf: Status 404 returned error can't find the container with id eca058a08f8454377e130194ee5c35ae09500f7dcda97b751d1e065a38dfb8cf
Sep 19 15:16:30.785895 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:30.785862    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:30.942252 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:30.942169    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:31.043451 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:31.043414    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:31.154319 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:31.154287    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b7d5bc959-97rck" event={"ID":"5739e99a-2d54-4d00-bd3e-a9c3df7216dd","Type":"ContainerStarted","Data":"e151143e3c4e38b912f696daba502ef7cac478e8a66fb3a5890fd664cc2c6479"}
Sep 19 15:16:31.154481 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:31.154341    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b7d5bc959-97rck" event={"ID":"5739e99a-2d54-4d00-bd3e-a9c3df7216dd","Type":"ContainerStarted","Data":"eca058a08f8454377e130194ee5c35ae09500f7dcda97b751d1e065a38dfb8cf"}
Sep 19 15:16:31.154481 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:31.154433    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:16:31.172410 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:31.172352    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b7d5bc959-97rck" podStartSLOduration=17.172333444 podStartE2EDuration="17.172333444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:16:31.170890189 +0000 UTC m=+254.334305239" watchObservedRunningTime="2026-09-19 15:16:31.172333444 +0000 UTC m=+254.335748485"
Sep 19 15:16:31.180617 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:31.180556    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:32.184430 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:32.184394    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:32.359769 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:32.359728    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:32.460746 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:32.460680    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:32.785509 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:32.785486    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:32.983449 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:32.983418    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:33.381171 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:33.381141    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:33.983758 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:33.983726    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:34.384460 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:34.384415    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:34.587218 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:34.587172    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:34.989188 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:34.989154    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:35.182450 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:35.182422    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:35.745586 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:35.745555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:35.745586 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:35.745587    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:35.746054 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:35.746037    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c930f9c-df8e-4bcb-bd9a-c056107829a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:35.747874 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:35.747859    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c930f9c-df8e-4bcb-bd9a-c056107829a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwbp8\" (UID: \"5c930f9c-df8e-4bcb-bd9a-c056107829a0\") " pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:35.791735 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:35.791712    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xwbp8"
Sep 19 15:16:36.060529 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:36.060502    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xwbp8"]
Sep 19 15:16:36.063365 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:16:36.063342    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c930f9c_df8e_4bcb_bd9a_c056107829a0.slice/crio-6a4ec4493eb25158d1ae256fe4fda77b878701a70c58879cc6d7aa4af491bf1c WatchSource:0}: Error finding container 6a4ec4493eb25158d1ae256fe4fda77b878701a70c58879cc6d7aa4af491bf1c: Status 404 returned error can't find the container with id 6a4ec4493eb25158d1ae256fe4fda77b878701a70c58879cc6d7aa4af491bf1c
Sep 19 15:16:36.170409 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:36.170386    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xwbp8" event={"ID":"5c930f9c-df8e-4bcb-bd9a-c056107829a0","Type":"ContainerStarted","Data":"cd84d17337f83dbb1ecfe0b0f45019eca5e1dcc3979d960120536824373a756d"}
Sep 19 15:16:36.170554 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:36.170435    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xwbp8" event={"ID":"5c930f9c-df8e-4bcb-bd9a-c056107829a0","Type":"ContainerStarted","Data":"6a4ec4493eb25158d1ae256fe4fda77b878701a70c58879cc6d7aa4af491bf1c"}
Sep 19 15:16:37.174910 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:37.174875    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xwbp8" event={"ID":"5c930f9c-df8e-4bcb-bd9a-c056107829a0","Type":"ContainerStarted","Data":"46dbb784c0ca5d923362d6e9d47483d4960e33f3e4b7956d7a1b2c077c4d11fb"}
Sep 19 15:16:39.183147 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:39.183111    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xwbp8" event={"ID":"5c930f9c-df8e-4bcb-bd9a-c056107829a0","Type":"ContainerStarted","Data":"968fc9193dd98cb7d690d8f26161ebbda0b7773b61987616f222b16417546cba"}
Sep 19 15:16:39.198910 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:39.198853    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xwbp8" podStartSLOduration=18.246999084 podStartE2EDuration="20.198839893s" totalImagesPullingTime="1.951840809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:16:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:16:39.198176173 +0000 UTC m=+262.361591215" watchObservedRunningTime="2026-09-19 15:16:39.198839893 +0000 UTC m=+262.362254933"
Sep 19 15:16:40.157031 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:40.156997    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b7d5bc959-97rck"]
Sep 19 15:16:40.171307 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:40.171273    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:40.262990 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:40.262962    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:40.363687 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:40.363656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:40.982393 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:40.982366    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-vp9qx"]
Sep 19 15:16:40.985264 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:40.985250    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-vp9qx"
Sep 19 15:16:40.987363 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:40.987337    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 19 15:16:40.987363 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:40.987350    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-v4pjr\""
Sep 19 15:16:40.987541 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:40.987336    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 19 15:16:40.988213 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:40.988173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:40.993916 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:40.993897    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-vp9qx"]
Sep 19 15:16:41.080273 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:41.080246    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbr9h\" (UniqueName: \"kubernetes.io/projected/8ffc9247-0f31-4479-8fe3-fedd3e344726-kube-api-access-lbr9h\") pod \"downloads-6594f4c75-vp9qx\" (UID: \"8ffc9247-0f31-4479-8fe3-fedd3e344726\") " pod="openshift-console/downloads-6594f4c75-vp9qx"
Sep 19 15:16:41.085505 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:41.085485    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:41.134539 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:41.134516    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:41.180992 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:41.180970    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbr9h\" (UniqueName: \"kubernetes.io/projected/8ffc9247-0f31-4479-8fe3-fedd3e344726-kube-api-access-lbr9h\") pod \"downloads-6594f4c75-vp9qx\" (UID: \"8ffc9247-0f31-4479-8fe3-fedd3e344726\") " pod="openshift-console/downloads-6594f4c75-vp9qx"
Sep 19 15:16:41.189132 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:41.189110    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbr9h\" (UniqueName: \"kubernetes.io/projected/8ffc9247-0f31-4479-8fe3-fedd3e344726-kube-api-access-lbr9h\") pod \"downloads-6594f4c75-vp9qx\" (UID: \"8ffc9247-0f31-4479-8fe3-fedd3e344726\") " pod="openshift-console/downloads-6594f4c75-vp9qx"
Sep 19 15:16:41.292595 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:41.292574    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:41.294187 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:41.294172    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-vp9qx"
Sep 19 15:16:41.448476 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:41.448434    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:41.498007 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:41.497963    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:41.562375 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:41.562320    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-vp9qx"]
Sep 19 15:16:41.565627 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:16:41.565601    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ffc9247_0f31_4479_8fe3_fedd3e344726.slice/crio-46e345eba698925c2a226e3fb70e93c3bbc434d0ab53146e00b63790eeee10da WatchSource:0}: Error finding container 46e345eba698925c2a226e3fb70e93c3bbc434d0ab53146e00b63790eeee10da: Status 404 returned error can't find the container with id 46e345eba698925c2a226e3fb70e93c3bbc434d0ab53146e00b63790eeee10da
Sep 19 15:16:41.662847 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:41.662824    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:41.714894 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:41.714871    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:42.059985 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:42.059959    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:42.127208 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:42.127158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:42.194772 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:42.194737    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-vp9qx" event={"ID":"8ffc9247-0f31-4479-8fe3-fedd3e344726","Type":"ContainerStarted","Data":"46e345eba698925c2a226e3fb70e93c3bbc434d0ab53146e00b63790eeee10da"}
Sep 19 15:16:42.677049 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:42.677020    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:42.882993 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:42.882960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:42.983477 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:42.983386    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:43.485709 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:43.485670    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:43.530702 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:43.530674    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:48.758048 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:48.758014    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:48.857716 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:48.857672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:48.910297 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:48.910268    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4blwd"]
Sep 19 15:16:48.915400 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:48.915379    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4blwd"
Sep 19 15:16:48.916570 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:48.916540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:48.917337 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:48.917319    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5x88d\""
Sep 19 15:16:48.917434 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:48.917363    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 19 15:16:48.920835 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:48.920810    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4blwd"]
Sep 19 15:16:48.935672 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:48.935645    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7402a1b4-c269-40aa-af9c-c31b7682d427-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-4blwd\" (UID: \"7402a1b4-c269-40aa-af9c-c31b7682d427\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4blwd"
Sep 19 15:16:49.036650 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.036617    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7402a1b4-c269-40aa-af9c-c31b7682d427-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-4blwd\" (UID: \"7402a1b4-c269-40aa-af9c-c31b7682d427\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4blwd"
Sep 19 15:16:49.036835 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:49.036808    2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 19 15:16:49.036955 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:49.036882    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7402a1b4-c269-40aa-af9c-c31b7682d427-tls-certificates podName:7402a1b4-c269-40aa-af9c-c31b7682d427 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:49.536865687 +0000 UTC m=+272.700280704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7402a1b4-c269-40aa-af9c-c31b7682d427-tls-certificates") pod "prometheus-operator-admission-webhook-5c6747dc7b-4blwd" (UID: "7402a1b4-c269-40aa-af9c-c31b7682d427") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 19 15:16:49.111613 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.111570    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:49.500308 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.500236    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55b45644bc-c6mxt"]
Sep 19 15:16:49.504286 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.504264    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.506526 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.506500    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 19 15:16:49.507402 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.507373    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 19 15:16:49.507538 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.507410    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 19 15:16:49.507538 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.507441    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xd7nv\""
Sep 19 15:16:49.507538 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.507497    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 19 15:16:49.507538 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.507441    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 19 15:16:49.513747 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.513730    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55b45644bc-c6mxt"]
Sep 19 15:16:49.541011 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.540985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7402a1b4-c269-40aa-af9c-c31b7682d427-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-4blwd\" (UID: \"7402a1b4-c269-40aa-af9c-c31b7682d427\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4blwd"
Sep 19 15:16:49.541116 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.541037    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-serving-cert\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.541116 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.541070    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-service-ca\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.541255 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.541116    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-config\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.541255 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.541133    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-oauth-config\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.541255 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.541187    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-oauth-serving-cert\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.541255 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.541230    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24bvr\" (UniqueName: \"kubernetes.io/projected/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-kube-api-access-24bvr\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.543685 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.543669    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7402a1b4-c269-40aa-af9c-c31b7682d427-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-4blwd\" (UID: \"7402a1b4-c269-40aa-af9c-c31b7682d427\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4blwd"
Sep 19 15:16:49.641974 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.641946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-config\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.642095 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.641979    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-oauth-config\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.642095 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.642002    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-oauth-serving-cert\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.642095 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.642029    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24bvr\" (UniqueName: \"kubernetes.io/projected/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-kube-api-access-24bvr\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.642095 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.642071    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-serving-cert\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.642333 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.642108    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-service-ca\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.642875 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.642746    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-config\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.642875 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.642854    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-oauth-serving-cert\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.642875 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.642858    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-service-ca\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.644874 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.644850    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-serving-cert\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.644979 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.644960    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-oauth-config\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.649660 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.649641    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24bvr\" (UniqueName: \"kubernetes.io/projected/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-kube-api-access-24bvr\") pod \"console-55b45644bc-c6mxt\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") " pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.815836 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.815813    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:16:49.827016 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:49.826989    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4blwd"
Sep 19 15:16:50.095874 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:50.095620    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55b45644bc-c6mxt"]
Sep 19 15:16:50.099602 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:16:50.099571    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0afa330c_a6e6_4a2c_adf0_f33c7f7616f2.slice/crio-eeaf82224e3060699e661bc63c02028bb254eca7200995d7cb3179cdc2b53162 WatchSource:0}: Error finding container eeaf82224e3060699e661bc63c02028bb254eca7200995d7cb3179cdc2b53162: Status 404 returned error can't find the container with id eeaf82224e3060699e661bc63c02028bb254eca7200995d7cb3179cdc2b53162
Sep 19 15:16:50.105282 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:50.105257    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4blwd"]
Sep 19 15:16:50.109307 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:16:50.109286    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7402a1b4_c269_40aa_af9c_c31b7682d427.slice/crio-1f632e8a21abf5ade484c1e0c3835dbf676cd8f3508919692abd79e74a4b628c WatchSource:0}: Error finding container 1f632e8a21abf5ade484c1e0c3835dbf676cd8f3508919692abd79e74a4b628c: Status 404 returned error can't find the container with id 1f632e8a21abf5ade484c1e0c3835dbf676cd8f3508919692abd79e74a4b628c
Sep 19 15:16:50.164506 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:50.164483    2562 patch_prober.go:28] interesting pod/image-registry-b7d5bc959-97rck container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 19 15:16:50.164629 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:50.164521    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b7d5bc959-97rck" podUID="5739e99a-2d54-4d00-bd3e-a9c3df7216dd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 15:16:50.224307 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:50.224272    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4blwd" event={"ID":"7402a1b4-c269-40aa-af9c-c31b7682d427","Type":"ContainerStarted","Data":"1f632e8a21abf5ade484c1e0c3835dbf676cd8f3508919692abd79e74a4b628c"}
Sep 19 15:16:50.225648 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:50.225624    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55b45644bc-c6mxt" event={"ID":"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2","Type":"ContainerStarted","Data":"eeaf82224e3060699e661bc63c02028bb254eca7200995d7cb3179cdc2b53162"}
Sep 19 15:16:51.516098 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:51.516063    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:51.617334 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:51.617305    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:54.678982 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:54.678940    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:54.780172 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:54.780137    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:54.831331 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:54.831298    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:56.451067 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.451009    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:56.497985 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.497955    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-844489c87-76mgn"]
Sep 19 15:16:56.502175 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.502149    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.509892 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.509859    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 19 15:16:56.510650 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.510628    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844489c87-76mgn"]
Sep 19 15:16:56.514145 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.514114    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:16:56.595672 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.595636    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-trusted-ca-bundle\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.595866 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.595682    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-oauth-config\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.595866 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.595712    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjvc5\" (UniqueName: \"kubernetes.io/projected/f2ee2bba-442c-477c-bef6-fdb3bf517bab-kube-api-access-vjvc5\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.595866 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.595797    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-service-ca\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.595866 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.595839    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-serving-cert\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.596071 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.595867    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-oauth-serving-cert\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.596071 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.595906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-config\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.697173 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.697137    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-trusted-ca-bundle\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.697344 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.697213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-oauth-config\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.697407 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.697345    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjvc5\" (UniqueName: \"kubernetes.io/projected/f2ee2bba-442c-477c-bef6-fdb3bf517bab-kube-api-access-vjvc5\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.697407 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.697391    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-service-ca\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.697524 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.697418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-serving-cert\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.697524 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.697444    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-oauth-serving-cert\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.697524 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.697473    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-config\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.698181 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.698158    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-trusted-ca-bundle\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.698298 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.698225    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-config\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.698444 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.698424    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-service-ca\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.698499 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.698424    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-oauth-serving-cert\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.700070 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.700045    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-oauth-config\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.700674 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.700649    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-serving-cert\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.705227 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.705160    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjvc5\" (UniqueName: \"kubernetes.io/projected/f2ee2bba-442c-477c-bef6-fdb3bf517bab-kube-api-access-vjvc5\") pod \"console-844489c87-76mgn\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") " pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:56.815134 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:56.815106    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:16:57.466503 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:57.465797    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844489c87-76mgn"]
Sep 19 15:16:57.476413 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:16:57.476381    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ee2bba_442c_477c_bef6_fdb3bf517bab.slice/crio-fdfde1f4812671189ca246d4ffa5f6e365d7f770c895eecf85331de1d9aaf19a WatchSource:0}: Error finding container fdfde1f4812671189ca246d4ffa5f6e365d7f770c895eecf85331de1d9aaf19a: Status 404 returned error can't find the container with id fdfde1f4812671189ca246d4ffa5f6e365d7f770c895eecf85331de1d9aaf19a
Sep 19 15:16:58.261263 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:58.260483    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-vp9qx" event={"ID":"8ffc9247-0f31-4479-8fe3-fedd3e344726","Type":"ContainerStarted","Data":"a9be2c0e2882ae54d6a992cbaee390d7d2843a236ecd51df591e7e2d81ef56bf"}
Sep 19 15:16:58.261550 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:58.261488    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-vp9qx"
Sep 19 15:16:58.267113 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:58.266725    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844489c87-76mgn" event={"ID":"f2ee2bba-442c-477c-bef6-fdb3bf517bab","Type":"ContainerStarted","Data":"fdfde1f4812671189ca246d4ffa5f6e365d7f770c895eecf85331de1d9aaf19a"}
Sep 19 15:16:58.279368 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:58.278453    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-vp9qx" podStartSLOduration=2.552729764 podStartE2EDuration="18.278436686s" totalImagesPullingTime="15.725706922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:16:58.275666929 +0000 UTC m=+281.439081969" watchObservedRunningTime="2026-09-19 15:16:58.278436686 +0000 UTC m=+281.441851727"
Sep 19 15:16:58.279368 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:58.279178    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-vp9qx"
Sep 19 15:16:58.886358 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:16:58.886190    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-45sbs" podUID="36959d15-6f58-4b56-9dfc-be887a6f07b1"
Sep 19 15:16:59.274763 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:16:59.273971    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-45sbs"
Sep 19 15:17:00.166078 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:00.165730    2562 patch_prober.go:28] interesting pod/image-registry-b7d5bc959-97rck container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 19 15:17:00.166078 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:00.165891    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b7d5bc959-97rck" podUID="5739e99a-2d54-4d00-bd3e-a9c3df7216dd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 15:17:02.071856 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:02.071807    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:17:02.074939 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:02.074883    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36959d15-6f58-4b56-9dfc-be887a6f07b1-metrics-tls\") pod \"dns-default-45sbs\" (UID: \"36959d15-6f58-4b56-9dfc-be887a6f07b1\") " pod="openshift-dns/dns-default-45sbs"
Sep 19 15:17:02.277505 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:02.277471    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p4wjr\""
Sep 19 15:17:02.285176 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:02.285120    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-45sbs"
Sep 19 15:17:04.068421 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:04.068352    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-45sbs"]
Sep 19 15:17:04.206131 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:17:04.206092    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36959d15_6f58_4b56_9dfc_be887a6f07b1.slice/crio-c71e7cf39bec1452712c4260e0c2deccbcea3e9e2b9c7e688349080e69c7a345 WatchSource:0}: Error finding container c71e7cf39bec1452712c4260e0c2deccbcea3e9e2b9c7e688349080e69c7a345: Status 404 returned error can't find the container with id c71e7cf39bec1452712c4260e0c2deccbcea3e9e2b9c7e688349080e69c7a345
Sep 19 15:17:04.297218 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:04.297162    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4blwd" event={"ID":"7402a1b4-c269-40aa-af9c-c31b7682d427","Type":"ContainerStarted","Data":"cf4e13fb127ed5bf8f9417ee5f2b084220a8a9a62b4c65cd93e6319e1b5e1dfd"}
Sep 19 15:17:04.297430 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:04.297370    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4blwd"
Sep 19 15:17:04.298604 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:04.298577    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-45sbs" event={"ID":"36959d15-6f58-4b56-9dfc-be887a6f07b1","Type":"ContainerStarted","Data":"c71e7cf39bec1452712c4260e0c2deccbcea3e9e2b9c7e688349080e69c7a345"}
Sep 19 15:17:04.302591 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:04.302570    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4blwd"
Sep 19 15:17:04.311013 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:04.310969    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-4blwd" podStartSLOduration=2.624175626 podStartE2EDuration="16.310954452s" totalImagesPullingTime="13.686778826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:16:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:17:04.310375074 +0000 UTC m=+287.473790118" watchObservedRunningTime="2026-09-19 15:17:04.310954452 +0000 UTC m=+287.474369492"
Sep 19 15:17:04.940405 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:04.940349    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:05.002688 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:05.002637    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:05.176253 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:05.176213    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b7d5bc959-97rck" podUID="5739e99a-2d54-4d00-bd3e-a9c3df7216dd" containerName="registry" containerID="cri-o://e151143e3c4e38b912f696daba502ef7cac478e8a66fb3a5890fd664cc2c6479" gracePeriod=30
Sep 19 15:17:05.230369 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:05.230287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:05.305683 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:05.305623    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55b45644bc-c6mxt" event={"ID":"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2","Type":"ContainerStarted","Data":"53ff729170d2d7262fbf84be439d44f035042042ef278ad754f9165db72f14b4"}
Sep 19 15:17:05.308563 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:05.308397    2562 generic.go:356] "Generic (PLEG): container finished" podID="5739e99a-2d54-4d00-bd3e-a9c3df7216dd" containerID="e151143e3c4e38b912f696daba502ef7cac478e8a66fb3a5890fd664cc2c6479" exitCode=0
Sep 19 15:17:05.308563 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:05.308494    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b7d5bc959-97rck" event={"ID":"5739e99a-2d54-4d00-bd3e-a9c3df7216dd","Type":"ContainerDied","Data":"e151143e3c4e38b912f696daba502ef7cac478e8a66fb3a5890fd664cc2c6479"}
Sep 19 15:17:05.311924 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:05.311878    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844489c87-76mgn" event={"ID":"f2ee2bba-442c-477c-bef6-fdb3bf517bab","Type":"ContainerStarted","Data":"6c185e15967b02490c13abd9850c15d5752da29f102e7e49f30c9c56895691da"}
Sep 19 15:17:05.323025 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:05.322971    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55b45644bc-c6mxt" podStartSLOduration=2.048736737 podStartE2EDuration="16.322950275s" totalImagesPullingTime="14.274213538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:16:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:17:05.322622066 +0000 UTC m=+288.486037107" watchObservedRunningTime="2026-09-19 15:17:05.322950275 +0000 UTC m=+288.486365316"
Sep 19 15:17:06.052912 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.052887    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:17:06.072602 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.072555    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-844489c87-76mgn" podStartSLOduration=3.159792416 podStartE2EDuration="10.072536181s" totalImagesPullingTime="6.912743765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:17:05.340919599 +0000 UTC m=+288.504334642" watchObservedRunningTime="2026-09-19 15:17:06.072536181 +0000 UTC m=+289.235951223"
Sep 19 15:17:06.209312 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.209293    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-installation-pull-secrets\") pod \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") "
Sep 19 15:17:06.209713 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.209321    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-trusted-ca\") pod \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") "
Sep 19 15:17:06.209713 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.209343    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-image-registry-private-configuration\") pod \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") "
Sep 19 15:17:06.209713 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.209367    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjl8f\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-kube-api-access-wjl8f\") pod \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") "
Sep 19 15:17:06.209713 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.209388    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-certificates\") pod \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") "
Sep 19 15:17:06.209713 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.209436    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-ca-trust-extracted\") pod \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") "
Sep 19 15:17:06.209713 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.209463    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls\") pod \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") "
Sep 19 15:17:06.209713 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.209490    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-bound-sa-token\") pod \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\" (UID: \"5739e99a-2d54-4d00-bd3e-a9c3df7216dd\") "
Sep 19 15:17:06.210303 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.209872    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5739e99a-2d54-4d00-bd3e-a9c3df7216dd" (UID: "5739e99a-2d54-4d00-bd3e-a9c3df7216dd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:17:06.210303 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.209901    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5739e99a-2d54-4d00-bd3e-a9c3df7216dd" (UID: "5739e99a-2d54-4d00-bd3e-a9c3df7216dd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:17:06.211956 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.211922    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5739e99a-2d54-4d00-bd3e-a9c3df7216dd" (UID: "5739e99a-2d54-4d00-bd3e-a9c3df7216dd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:17:06.212113 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.212073    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5739e99a-2d54-4d00-bd3e-a9c3df7216dd" (UID: "5739e99a-2d54-4d00-bd3e-a9c3df7216dd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:17:06.212305 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.212275    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5739e99a-2d54-4d00-bd3e-a9c3df7216dd" (UID: "5739e99a-2d54-4d00-bd3e-a9c3df7216dd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:17:06.212415 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.212321    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5739e99a-2d54-4d00-bd3e-a9c3df7216dd" (UID: "5739e99a-2d54-4d00-bd3e-a9c3df7216dd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:17:06.212505 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.212488    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-kube-api-access-wjl8f" (OuterVolumeSpecName: "kube-api-access-wjl8f") pod "5739e99a-2d54-4d00-bd3e-a9c3df7216dd" (UID: "5739e99a-2d54-4d00-bd3e-a9c3df7216dd"). InnerVolumeSpecName "kube-api-access-wjl8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:17:06.218502 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.218476    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5739e99a-2d54-4d00-bd3e-a9c3df7216dd" (UID: "5739e99a-2d54-4d00-bd3e-a9c3df7216dd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:17:06.310887 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.310487    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-image-registry-private-configuration\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:06.310887 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.310525    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjl8f\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-kube-api-access-wjl8f\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:06.310887 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.310544    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-certificates\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:06.310887 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.310559    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-ca-trust-extracted\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:06.310887 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.310580    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-registry-tls\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:06.310887 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.310594    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-bound-sa-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:06.310887 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.310607    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-installation-pull-secrets\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:06.310887 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.310623    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5739e99a-2d54-4d00-bd3e-a9c3df7216dd-trusted-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:06.318593 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.318574    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7d5bc959-97rck"
Sep 19 15:17:06.318669 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.318622    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b7d5bc959-97rck" event={"ID":"5739e99a-2d54-4d00-bd3e-a9c3df7216dd","Type":"ContainerDied","Data":"eca058a08f8454377e130194ee5c35ae09500f7dcda97b751d1e065a38dfb8cf"}
Sep 19 15:17:06.318713 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.318700    2562 scope.go:117] "RemoveContainer" containerID="e151143e3c4e38b912f696daba502ef7cac478e8a66fb3a5890fd664cc2c6479"
Sep 19 15:17:06.337897 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.337876    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b7d5bc959-97rck"]
Sep 19 15:17:06.341605 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.341587    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b7d5bc959-97rck"]
Sep 19 15:17:06.815355 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.815317    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:17:06.815517 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.815375    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:17:06.816378 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.816360    2562 patch_prober.go:28] interesting pod/console-844489c87-76mgn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" start-of-body=
Sep 19 15:17:06.816425 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.816400    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-844489c87-76mgn" podUID="f2ee2bba-442c-477c-bef6-fdb3bf517bab" containerName="console" probeResult="failure" output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused"
Sep 19 15:17:06.835337 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.835277    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:06.935640 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:06.935602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:07.036073 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:07.036040    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:07.136684 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:07.136604    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:07.324701 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:07.324656    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-45sbs" event={"ID":"36959d15-6f58-4b56-9dfc-be887a6f07b1","Type":"ContainerStarted","Data":"f24e804386fda3977b2450bc6514bb058b046e2cc46a3bcbf3dd3c45fed8d58c"}
Sep 19 15:17:07.325091 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:07.324719    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-45sbs" event={"ID":"36959d15-6f58-4b56-9dfc-be887a6f07b1","Type":"ContainerStarted","Data":"f6b6331e497245b4a66837c6fa952433725f17fb347cad9e5eb398d193248c16"}
Sep 19 15:17:07.325091 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:07.324751    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-45sbs"
Sep 19 15:17:07.340432 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:07.340389    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-45sbs" podStartSLOduration=253.181115263 podStartE2EDuration="4m15.340376088s" totalImagesPullingTime="2.159260825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:17:07.339475367 +0000 UTC m=+290.502890406" watchObservedRunningTime="2026-09-19 15:17:07.340376088 +0000 UTC m=+290.503791140"
Sep 19 15:17:07.343363 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:07.343339    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5739e99a-2d54-4d00-bd3e-a9c3df7216dd" path="/var/lib/kubelet/pods/5739e99a-2d54-4d00-bd3e-a9c3df7216dd/volumes"
Sep 19 15:17:09.062086 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.062050    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:09.294453 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.294420    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z"]
Sep 19 15:17:09.294646 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.294635    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5739e99a-2d54-4d00-bd3e-a9c3df7216dd" containerName="registry"
Sep 19 15:17:09.294694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.294648    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5739e99a-2d54-4d00-bd3e-a9c3df7216dd" containerName="registry"
Sep 19 15:17:09.294726 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.294696    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5739e99a-2d54-4d00-bd3e-a9c3df7216dd" containerName="registry"
Sep 19 15:17:09.309602 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.309575    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z"]
Sep 19 15:17:09.309742 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.309620    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z"
Sep 19 15:17:09.313342 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.313277    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 19 15:17:09.313342 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.313277    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 19 15:17:09.313535 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.313511    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 19 15:17:09.313601 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.313537    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9xkfh\""
Sep 19 15:17:09.313601 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.313596    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 19 15:17:09.313703 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.313632    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 19 15:17:09.314855 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.314791    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c4b8p"]
Sep 19 15:17:09.336508 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.336488    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.340971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.340942    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w8ll2\""
Sep 19 15:17:09.341068 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.341048    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 19 15:17:09.341316 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.341297    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 19 15:17:09.342226 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.342188    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 19 15:17:09.431845 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.431810    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42b4977e-7575-4b78-8494-a8380a00dc70-node-exporter-tls\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.432008 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.431849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfzdz\" (UniqueName: \"kubernetes.io/projected/42b4977e-7575-4b78-8494-a8380a00dc70-kube-api-access-tfzdz\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.432008 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.431882    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42b4977e-7575-4b78-8494-a8380a00dc70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.432008 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.431904    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42b4977e-7575-4b78-8494-a8380a00dc70-root\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.432008 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.431928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeef2cba-8699-4b27-8391-05dbab24bf55-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-4jl5z\" (UID: \"eeef2cba-8699-4b27-8391-05dbab24bf55\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z"
Sep 19 15:17:09.432008 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.431953    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42b4977e-7575-4b78-8494-a8380a00dc70-node-exporter-wtmp\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.432298 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.432007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42b4977e-7575-4b78-8494-a8380a00dc70-sys\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.432298 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.432065    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42b4977e-7575-4b78-8494-a8380a00dc70-node-exporter-accelerators-collector-config\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.432298 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.432100    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42b4977e-7575-4b78-8494-a8380a00dc70-metrics-client-ca\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.432298 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.432128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eeef2cba-8699-4b27-8391-05dbab24bf55-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-4jl5z\" (UID: \"eeef2cba-8699-4b27-8391-05dbab24bf55\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z"
Sep 19 15:17:09.432298 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.432158    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eeef2cba-8699-4b27-8391-05dbab24bf55-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-4jl5z\" (UID: \"eeef2cba-8699-4b27-8391-05dbab24bf55\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z"
Sep 19 15:17:09.432298 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.432182    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwdt5\" (UniqueName: \"kubernetes.io/projected/eeef2cba-8699-4b27-8391-05dbab24bf55-kube-api-access-cwdt5\") pod \"openshift-state-metrics-86c5bc79d6-4jl5z\" (UID: \"eeef2cba-8699-4b27-8391-05dbab24bf55\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z"
Sep 19 15:17:09.432298 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.432258    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42b4977e-7575-4b78-8494-a8380a00dc70-node-exporter-textfile\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.533524 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.533488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42b4977e-7575-4b78-8494-a8380a00dc70-node-exporter-tls\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.533672 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.533528    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzdz\" (UniqueName: \"kubernetes.io/projected/42b4977e-7575-4b78-8494-a8380a00dc70-kube-api-access-tfzdz\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.533672 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.533558    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42b4977e-7575-4b78-8494-a8380a00dc70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.533672 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.533581    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42b4977e-7575-4b78-8494-a8380a00dc70-root\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.533672 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.533606    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeef2cba-8699-4b27-8391-05dbab24bf55-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-4jl5z\" (UID: \"eeef2cba-8699-4b27-8391-05dbab24bf55\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z"
Sep 19 15:17:09.533672 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.533633    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42b4977e-7575-4b78-8494-a8380a00dc70-node-exporter-wtmp\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.533672 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.533669    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42b4977e-7575-4b78-8494-a8380a00dc70-sys\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.533990 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.533696    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42b4977e-7575-4b78-8494-a8380a00dc70-node-exporter-accelerators-collector-config\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.533990 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.533715    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42b4977e-7575-4b78-8494-a8380a00dc70-root\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.533990 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.533735    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42b4977e-7575-4b78-8494-a8380a00dc70-metrics-client-ca\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.533990 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.533763    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eeef2cba-8699-4b27-8391-05dbab24bf55-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-4jl5z\" (UID: \"eeef2cba-8699-4b27-8391-05dbab24bf55\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z"
Sep 19 15:17:09.533990 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.533772    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42b4977e-7575-4b78-8494-a8380a00dc70-sys\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.533990 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.533792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eeef2cba-8699-4b27-8391-05dbab24bf55-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-4jl5z\" (UID: \"eeef2cba-8699-4b27-8391-05dbab24bf55\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z"
Sep 19 15:17:09.533990 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.533818    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwdt5\" (UniqueName: \"kubernetes.io/projected/eeef2cba-8699-4b27-8391-05dbab24bf55-kube-api-access-cwdt5\") pod \"openshift-state-metrics-86c5bc79d6-4jl5z\" (UID: \"eeef2cba-8699-4b27-8391-05dbab24bf55\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z"
Sep 19 15:17:09.533990 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.533857    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42b4977e-7575-4b78-8494-a8380a00dc70-node-exporter-textfile\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.533990 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.533885    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42b4977e-7575-4b78-8494-a8380a00dc70-node-exporter-wtmp\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.534464 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.534414    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42b4977e-7575-4b78-8494-a8380a00dc70-node-exporter-accelerators-collector-config\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.534520 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.534505    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42b4977e-7575-4b78-8494-a8380a00dc70-node-exporter-textfile\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.534690 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.534657    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42b4977e-7575-4b78-8494-a8380a00dc70-metrics-client-ca\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.535136 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.535112    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeef2cba-8699-4b27-8391-05dbab24bf55-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-4jl5z\" (UID: \"eeef2cba-8699-4b27-8391-05dbab24bf55\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z"
Sep 19 15:17:09.536155 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.536126    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42b4977e-7575-4b78-8494-a8380a00dc70-node-exporter-tls\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.536703 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.536677    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eeef2cba-8699-4b27-8391-05dbab24bf55-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-4jl5z\" (UID: \"eeef2cba-8699-4b27-8391-05dbab24bf55\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z"
Sep 19 15:17:09.536703 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.536693    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42b4977e-7575-4b78-8494-a8380a00dc70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.536975 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.536954    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eeef2cba-8699-4b27-8391-05dbab24bf55-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-4jl5z\" (UID: \"eeef2cba-8699-4b27-8391-05dbab24bf55\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z"
Sep 19 15:17:09.549658 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.549635    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfzdz\" (UniqueName: \"kubernetes.io/projected/42b4977e-7575-4b78-8494-a8380a00dc70-kube-api-access-tfzdz\") pod \"node-exporter-c4b8p\" (UID: \"42b4977e-7575-4b78-8494-a8380a00dc70\") " pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.553449 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.553425    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwdt5\" (UniqueName: \"kubernetes.io/projected/eeef2cba-8699-4b27-8391-05dbab24bf55-kube-api-access-cwdt5\") pod \"openshift-state-metrics-86c5bc79d6-4jl5z\" (UID: \"eeef2cba-8699-4b27-8391-05dbab24bf55\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z"
Sep 19 15:17:09.620035 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.619971    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z"
Sep 19 15:17:09.649329 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.649302    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c4b8p"
Sep 19 15:17:09.676299 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:17:09.676273    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b4977e_7575_4b78_8494_a8380a00dc70.slice/crio-7a512b03393477a9677db5fec3b9138366fd0426a20df97d084f9b7700ee6b21 WatchSource:0}: Error finding container 7a512b03393477a9677db5fec3b9138366fd0426a20df97d084f9b7700ee6b21: Status 404 returned error can't find the container with id 7a512b03393477a9677db5fec3b9138366fd0426a20df97d084f9b7700ee6b21
Sep 19 15:17:09.816376 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.816346    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:17:09.816508 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.816398    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:17:09.820680 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.820660    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:17:09.918741 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:09.918608    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z"]
Sep 19 15:17:09.920961 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:17:09.920939    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeef2cba_8699_4b27_8391_05dbab24bf55.slice/crio-df59e86d5dd4366627c4717c7b04cb24cf82832519894bc24e16866e6e159362 WatchSource:0}: Error finding container df59e86d5dd4366627c4717c7b04cb24cf82832519894bc24e16866e6e159362: Status 404 returned error can't find the container with id df59e86d5dd4366627c4717c7b04cb24cf82832519894bc24e16866e6e159362
Sep 19 15:17:10.231178 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:10.231097    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:10.330324 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:10.330292    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:10.336778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:10.336754    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c4b8p" event={"ID":"42b4977e-7575-4b78-8494-a8380a00dc70","Type":"ContainerStarted","Data":"7a512b03393477a9677db5fec3b9138366fd0426a20df97d084f9b7700ee6b21"}
Sep 19 15:17:10.339029 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:10.338996    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z" event={"ID":"eeef2cba-8699-4b27-8391-05dbab24bf55","Type":"ContainerStarted","Data":"0d8d5179c9ec080c6f1e7fdf6c08e2fc1976a6bdb3a31d1dabe691c1ac424311"}
Sep 19 15:17:10.339132 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:10.339055    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z" event={"ID":"eeef2cba-8699-4b27-8391-05dbab24bf55","Type":"ContainerStarted","Data":"dfa02c102cdbe5c32e839d32ab1b5aeeb27ea1cdf3ee3e43fa1a1b408c9384c2"}
Sep 19 15:17:10.339132 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:10.339083    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z" event={"ID":"eeef2cba-8699-4b27-8391-05dbab24bf55","Type":"ContainerStarted","Data":"df59e86d5dd4366627c4717c7b04cb24cf82832519894bc24e16866e6e159362"}
Sep 19 15:17:10.343500 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:10.343478    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:17:10.392875 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:10.392848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:10.546319 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:10.546284    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:11.339376 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:17:11.339187    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tmbmf" podUID="01ca12cf-99c7-4835-b150-0b653dfc1905"
Sep 19 15:17:11.345105 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:11.345076    2562 generic.go:356] "Generic (PLEG): container finished" podID="42b4977e-7575-4b78-8494-a8380a00dc70" containerID="77144f87cbe81e9fcd7ba7ee16b09ac6b34f8e63e0699782927337a1e83ba77f" exitCode=0
Sep 19 15:17:11.345456 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:11.345155    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c4b8p" event={"ID":"42b4977e-7575-4b78-8494-a8380a00dc70","Type":"ContainerDied","Data":"77144f87cbe81e9fcd7ba7ee16b09ac6b34f8e63e0699782927337a1e83ba77f"}
Sep 19 15:17:11.517966 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:11.517935    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:11.617694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:11.617623    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:12.088843 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.088815    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:12.189362 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.189329    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:12.286569 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.286541    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:12.292699 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.292669    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-64d7d46d-d4299"]
Sep 19 15:17:12.308499 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.308472    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64d7d46d-d4299"]
Sep 19 15:17:12.308606 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.308595    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.311220 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.311169    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 19 15:17:12.311342 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.311227    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 19 15:17:12.311342 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.311250    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 19 15:17:12.311342 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.311261    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 19 15:17:12.311342 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.311250    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 19 15:17:12.311550 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.311351    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-996qc\""
Sep 19 15:17:12.311550 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.311429    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-essi7jnps5lsg\""
Sep 19 15:17:12.350801 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.350764    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c4b8p" event={"ID":"42b4977e-7575-4b78-8494-a8380a00dc70","Type":"ContainerStarted","Data":"e13ca2b9f38a68a26b7a7f0f0ebec0d6f0e2ff7d01bfc9876a1d5ebb1e36c689"}
Sep 19 15:17:12.351118 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.350833    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c4b8p" event={"ID":"42b4977e-7575-4b78-8494-a8380a00dc70","Type":"ContainerStarted","Data":"3ef104516a26cbcbbd0a4b416a7f6c9811919cdc08224aac402c27e510a871cd"}
Sep 19 15:17:12.357018 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.356992    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z" event={"ID":"eeef2cba-8699-4b27-8391-05dbab24bf55","Type":"ContainerStarted","Data":"39b6381720cc864930b088770af0626cff12b0ce7f1763d817dd80376b83c2ee"}
Sep 19 15:17:12.380369 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.380330    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c4b8p" podStartSLOduration=1.86504109 podStartE2EDuration="3.380318327s" totalImagesPullingTime="1.428972046s" totalInitContainerRuntime="86.305191ms" isStatefulPod=true podCreationTimestamp="2026-09-19 15:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:17:12.379409606 +0000 UTC m=+295.542824646" watchObservedRunningTime="2026-09-19 15:17:12.380318327 +0000 UTC m=+295.543733367"
Sep 19 15:17:12.383631 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.383613    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:12.394787 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.394754    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4jl5z" podStartSLOduration=1.598279782 podStartE2EDuration="3.394743343s" totalImagesPullingTime="1.796463561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:17:12.394317868 +0000 UTC m=+295.557732907" watchObservedRunningTime="2026-09-19 15:17:12.394743343 +0000 UTC m=+295.558158381"
Sep 19 15:17:12.458236 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.458213    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-thanos-querier-tls\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.458340 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.458322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.458530 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.458513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9684n\" (UniqueName: \"kubernetes.io/projected/c2ef1642-31c5-4f40-8944-5a286a50ef27-kube-api-access-9684n\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.458587 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.458570    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.458676 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.458657    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.458749 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.458692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.458749 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.458718    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-grpc-tls\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.458859 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.458766    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2ef1642-31c5-4f40-8944-5a286a50ef27-metrics-client-ca\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.559069 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.559016    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.559069 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.559043    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.559069 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.559061    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-grpc-tls\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.559317 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.559092    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2ef1642-31c5-4f40-8944-5a286a50ef27-metrics-client-ca\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.559317 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.559121    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-thanos-querier-tls\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.559317 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.559171    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.559317 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.559230    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9684n\" (UniqueName: \"kubernetes.io/projected/c2ef1642-31c5-4f40-8944-5a286a50ef27-kube-api-access-9684n\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.559614 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.559537    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.560074 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.560049    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2ef1642-31c5-4f40-8944-5a286a50ef27-metrics-client-ca\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.562033 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.562004    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.562111 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.562053    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-grpc-tls\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.562306 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.562286    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.562361 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.562346    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.562454 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.562431    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.562498 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.562484    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c2ef1642-31c5-4f40-8944-5a286a50ef27-secret-thanos-querier-tls\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.566462 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.566440    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9684n\" (UniqueName: \"kubernetes.io/projected/c2ef1642-31c5-4f40-8944-5a286a50ef27-kube-api-access-9684n\") pod \"thanos-querier-64d7d46d-d4299\" (UID: \"c2ef1642-31c5-4f40-8944-5a286a50ef27\") " pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.596422 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.596382    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:12.618408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.618383    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:12.910457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:12.910390    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64d7d46d-d4299"]
Sep 19 15:17:12.914091 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:17:12.914067    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ef1642_31c5_4f40_8944_5a286a50ef27.slice/crio-be5c2959609278d132364420da04d42c9adb64d54949ce5b40f3a26f538048ac WatchSource:0}: Error finding container be5c2959609278d132364420da04d42c9adb64d54949ce5b40f3a26f538048ac: Status 404 returned error can't find the container with id be5c2959609278d132364420da04d42c9adb64d54949ce5b40f3a26f538048ac
Sep 19 15:17:13.361168 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.361139    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64d7d46d-d4299" event={"ID":"c2ef1642-31c5-4f40-8944-5a286a50ef27","Type":"ContainerStarted","Data":"be5c2959609278d132364420da04d42c9adb64d54949ce5b40f3a26f538048ac"}
Sep 19 15:17:13.615041 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.614962    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5c6b474b65-b8v8r"]
Sep 19 15:17:13.632727 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.632695    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c6b474b65-b8v8r"]
Sep 19 15:17:13.632885 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.632769    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.634921 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.634896    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 19 15:17:13.635259 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.635240    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 19 15:17:13.636049 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.636028    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4nl01c6anj8kt\""
Sep 19 15:17:13.636049 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.636041    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 19 15:17:13.636344 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.636326    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xg2px\""
Sep 19 15:17:13.636435 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.636355    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 19 15:17:13.769491 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.769458    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/396db92b-0d94-47e8-a410-d93b0d36c994-client-ca-bundle\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.769491 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.769500    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/396db92b-0d94-47e8-a410-d93b0d36c994-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.769733 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.769549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/396db92b-0d94-47e8-a410-d93b0d36c994-secret-metrics-server-tls\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.769733 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.769573    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/396db92b-0d94-47e8-a410-d93b0d36c994-secret-metrics-server-client-certs\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.769733 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.769595    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/396db92b-0d94-47e8-a410-d93b0d36c994-metrics-server-audit-profiles\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.769733 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.769621    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/396db92b-0d94-47e8-a410-d93b0d36c994-audit-log\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.769942 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.769747    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82rkb\" (UniqueName: \"kubernetes.io/projected/396db92b-0d94-47e8-a410-d93b0d36c994-kube-api-access-82rkb\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.870414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.870341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/396db92b-0d94-47e8-a410-d93b0d36c994-secret-metrics-server-tls\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.870414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.870379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/396db92b-0d94-47e8-a410-d93b0d36c994-secret-metrics-server-client-certs\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.870414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.870405    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/396db92b-0d94-47e8-a410-d93b0d36c994-metrics-server-audit-profiles\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.870674 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.870429    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/396db92b-0d94-47e8-a410-d93b0d36c994-audit-log\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.870674 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.870476    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82rkb\" (UniqueName: \"kubernetes.io/projected/396db92b-0d94-47e8-a410-d93b0d36c994-kube-api-access-82rkb\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.870674 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.870513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/396db92b-0d94-47e8-a410-d93b0d36c994-client-ca-bundle\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.870674 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.870543    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/396db92b-0d94-47e8-a410-d93b0d36c994-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.871013 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.870984    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/396db92b-0d94-47e8-a410-d93b0d36c994-audit-log\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.871381 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.871333    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/396db92b-0d94-47e8-a410-d93b0d36c994-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.871653 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.871512    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/396db92b-0d94-47e8-a410-d93b0d36c994-metrics-server-audit-profiles\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.873432 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.873406    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/396db92b-0d94-47e8-a410-d93b0d36c994-secret-metrics-server-client-certs\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.873852 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.873834    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/396db92b-0d94-47e8-a410-d93b0d36c994-client-ca-bundle\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.873924 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.873834    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/396db92b-0d94-47e8-a410-d93b0d36c994-secret-metrics-server-tls\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.878465 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.878436    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82rkb\" (UniqueName: \"kubernetes.io/projected/396db92b-0d94-47e8-a410-d93b0d36c994-kube-api-access-82rkb\") pod \"metrics-server-5c6b474b65-b8v8r\" (UID: \"396db92b-0d94-47e8-a410-d93b0d36c994\") " pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:13.944374 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:13.944347    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:14.097117 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.097081    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-j6f45"]
Sep 19 15:17:14.097509 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.097478    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:14.122227 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.122138    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-j6f45"]
Sep 19 15:17:14.122371 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.122250    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-j6f45"
Sep 19 15:17:14.124285 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.124260    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 19 15:17:14.124659 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.124630    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7mslh\""
Sep 19 15:17:14.153421 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.153380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:14.242129 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.242021    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c6b474b65-b8v8r"]
Sep 19 15:17:14.244476 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:17:14.244447    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod396db92b_0d94_47e8_a410_d93b0d36c994.slice/crio-ad9abe341305667a988d016ab888cab33d96cf34570e32308dc020d0a040201d WatchSource:0}: Error finding container ad9abe341305667a988d016ab888cab33d96cf34570e32308dc020d0a040201d: Status 404 returned error can't find the container with id ad9abe341305667a988d016ab888cab33d96cf34570e32308dc020d0a040201d
Sep 19 15:17:14.274082 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.274054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93247531-532a-4d98-bb85-9b6a44dfbbf7-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-j6f45\" (UID: \"93247531-532a-4d98-bb85-9b6a44dfbbf7\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-j6f45"
Sep 19 15:17:14.274238 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.274191    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt5tf\" (UniqueName: \"kubernetes.io/projected/93247531-532a-4d98-bb85-9b6a44dfbbf7-kube-api-access-jt5tf\") pod \"monitoring-plugin-5984459ff8-j6f45\" (UID: \"93247531-532a-4d98-bb85-9b6a44dfbbf7\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-j6f45"
Sep 19 15:17:14.300863 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.300838    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-844489c87-76mgn"]
Sep 19 15:17:14.331428 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.331401    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69899b565c-ws9ww"]
Sep 19 15:17:14.356571 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.356544    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69899b565c-ws9ww"]
Sep 19 15:17:14.356702 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.356651    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.366963 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.366939    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r" event={"ID":"396db92b-0d94-47e8-a410-d93b0d36c994","Type":"ContainerStarted","Data":"ad9abe341305667a988d016ab888cab33d96cf34570e32308dc020d0a040201d"}
Sep 19 15:17:14.375005 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.374939    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt5tf\" (UniqueName: \"kubernetes.io/projected/93247531-532a-4d98-bb85-9b6a44dfbbf7-kube-api-access-jt5tf\") pod \"monitoring-plugin-5984459ff8-j6f45\" (UID: \"93247531-532a-4d98-bb85-9b6a44dfbbf7\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-j6f45"
Sep 19 15:17:14.375005 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.374985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93247531-532a-4d98-bb85-9b6a44dfbbf7-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-j6f45\" (UID: \"93247531-532a-4d98-bb85-9b6a44dfbbf7\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-j6f45"
Sep 19 15:17:14.375221 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:17:14.375090    2562 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 19 15:17:14.375221 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:17:14.375142    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93247531-532a-4d98-bb85-9b6a44dfbbf7-monitoring-plugin-cert podName:93247531-532a-4d98-bb85-9b6a44dfbbf7 nodeName:}" failed. No retries permitted until 2026-09-19 15:17:14.875123956 +0000 UTC m=+298.038538976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/93247531-532a-4d98-bb85-9b6a44dfbbf7-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-j6f45" (UID: "93247531-532a-4d98-bb85-9b6a44dfbbf7") : secret "monitoring-plugin-cert" not found
Sep 19 15:17:14.382945 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.382926    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt5tf\" (UniqueName: \"kubernetes.io/projected/93247531-532a-4d98-bb85-9b6a44dfbbf7-kube-api-access-jt5tf\") pod \"monitoring-plugin-5984459ff8-j6f45\" (UID: \"93247531-532a-4d98-bb85-9b6a44dfbbf7\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-j6f45"
Sep 19 15:17:14.423842 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.423810    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:14.475462 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.475421    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-oauth-config\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.475462 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.475473    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-config\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.475699 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.475507    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-trusted-ca-bundle\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.475699 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.475577    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-serving-cert\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.475699 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.475608    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-service-ca\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.475699 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.475677    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4l2h\" (UniqueName: \"kubernetes.io/projected/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-kube-api-access-j4l2h\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.475868 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.475710    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-oauth-serving-cert\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.523497 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.523467    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:14.570189 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.570154    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:14.576396 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.576341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4l2h\" (UniqueName: \"kubernetes.io/projected/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-kube-api-access-j4l2h\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.576396 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.576384    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-oauth-serving-cert\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.576628 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.576595    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-oauth-config\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.576722 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.576658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-config\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.576722 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.576700    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-trusted-ca-bundle\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.576874 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.576773    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-serving-cert\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.576874 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.576798    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-service-ca\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.577169 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.577138    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-oauth-serving-cert\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.577556 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.577535    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-config\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.577703 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.577679    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-service-ca\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.577994 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.577975    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-trusted-ca-bundle\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.579470 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.579452    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-oauth-config\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.579802 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.579782    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-serving-cert\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.583569 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.583551    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4l2h\" (UniqueName: \"kubernetes.io/projected/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-kube-api-access-j4l2h\") pod \"console-69899b565c-ws9ww\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") " pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.666309 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.666222    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:14.880071 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.880041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93247531-532a-4d98-bb85-9b6a44dfbbf7-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-j6f45\" (UID: \"93247531-532a-4d98-bb85-9b6a44dfbbf7\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-j6f45"
Sep 19 15:17:14.882502 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:14.882479    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93247531-532a-4d98-bb85-9b6a44dfbbf7-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-j6f45\" (UID: \"93247531-532a-4d98-bb85-9b6a44dfbbf7\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-j6f45"
Sep 19 15:17:15.033670 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.033650    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-j6f45"
Sep 19 15:17:15.213325 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.213305    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69899b565c-ws9ww"]
Sep 19 15:17:15.298700 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:17:15.298669    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f84e90_e76b_4abe_a06b_b8f5c0b4da49.slice/crio-fce3ca8c2f27cf4acb998b09124a7913b30a579c488695904c638ecf0329b987 WatchSource:0}: Error finding container fce3ca8c2f27cf4acb998b09124a7913b30a579c488695904c638ecf0329b987: Status 404 returned error can't find the container with id fce3ca8c2f27cf4acb998b09124a7913b30a579c488695904c638ecf0329b987
Sep 19 15:17:15.315214 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.312007    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-j6f45"]
Sep 19 15:17:15.318362 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:17:15.318341    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93247531_532a_4d98_bb85_9b6a44dfbbf7.slice/crio-96ed2d89932554fff158074a59b4c8c81f88cae91ffaa186069b086c9564724b WatchSource:0}: Error finding container 96ed2d89932554fff158074a59b4c8c81f88cae91ffaa186069b086c9564724b: Status 404 returned error can't find the container with id 96ed2d89932554fff158074a59b4c8c81f88cae91ffaa186069b086c9564724b
Sep 19 15:17:15.372074 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.372009    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-j6f45" event={"ID":"93247531-532a-4d98-bb85-9b6a44dfbbf7","Type":"ContainerStarted","Data":"96ed2d89932554fff158074a59b4c8c81f88cae91ffaa186069b086c9564724b"}
Sep 19 15:17:15.373375 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.373347    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69899b565c-ws9ww" event={"ID":"50f84e90-e76b-4abe-a06b-b8f5c0b4da49","Type":"ContainerStarted","Data":"fce3ca8c2f27cf4acb998b09124a7913b30a579c488695904c638ecf0329b987"}
Sep 19 15:17:15.458525 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.458496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:15.464529 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.464328    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 15:17:15.481412 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.480904    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.482166 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.481898    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 15:17:15.486579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.483793    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 19 15:17:15.486579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.483967    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fchm2\""
Sep 19 15:17:15.486579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.484023    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 19 15:17:15.486579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.484055    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 19 15:17:15.486579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.484341    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 19 15:17:15.486579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.484379    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-45shiu3c8jn30\""
Sep 19 15:17:15.486579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.484406    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 19 15:17:15.486579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.484907    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 19 15:17:15.486579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.484964    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 19 15:17:15.486579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.484993    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 19 15:17:15.486579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.485164    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 19 15:17:15.486579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.485181    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 19 15:17:15.486579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.485483    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 19 15:17:15.486579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.485532    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 19 15:17:15.487618 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.487599    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 19 15:17:15.490737 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.490719    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 19 15:17:15.586263 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.586363 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.586363 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586331    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.586488 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586386    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.586488 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586457    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.586595 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcsk7\" (UniqueName: \"kubernetes.io/projected/45ff545d-3c71-4e63-a0d6-1d508eabdba5-kube-api-access-dcsk7\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.586595 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586541    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45ff545d-3c71-4e63-a0d6-1d508eabdba5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.586595 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586572    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.586735 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586605    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45ff545d-3c71-4e63-a0d6-1d508eabdba5-config-out\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.586735 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586629    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-web-config\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.586735 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586655    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.586840 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586735    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.586840 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586770    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.586916 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586861    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.586916 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586897    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.586991 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586929    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.586991 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.586991 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.586972    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.587095 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.587005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-config\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.587095 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.587049    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.688492 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688467    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.688607 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688504    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.688607 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688526    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.688607 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-config\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.688607 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688571    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.688607 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688599    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.688858 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.688858 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.688858 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688689    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.688858 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.688858 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688753    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcsk7\" (UniqueName: \"kubernetes.io/projected/45ff545d-3c71-4e63-a0d6-1d508eabdba5-kube-api-access-dcsk7\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.688858 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688794    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45ff545d-3c71-4e63-a0d6-1d508eabdba5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.688858 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688823    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.688858 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688856    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45ff545d-3c71-4e63-a0d6-1d508eabdba5-config-out\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.689222 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-web-config\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.689222 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.689222 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.689222 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.688976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.689222 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.689035    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.689222 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.689076    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.689681 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.689307    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.689681 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.689643    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.690566 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.690479    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.692385 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.692028    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.692488 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.692367    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.692965 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.692939    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.693066 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.693023    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45ff545d-3c71-4e63-a0d6-1d508eabdba5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.694177 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.693562    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.694177 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.693765    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.694177 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.693808    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-web-config\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.694177 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.694097    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.694440 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.694187    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.694440 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.694350    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45ff545d-3c71-4e63-a0d6-1d508eabdba5-config-out\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.694710 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.694689    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.695014 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.694949    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.696180 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.696127    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.696384 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.696358    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-config\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.696500 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.696481    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.696761 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.696737    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.697932 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.697914    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcsk7\" (UniqueName: \"kubernetes.io/projected/45ff545d-3c71-4e63-a0d6-1d508eabdba5-kube-api-access-dcsk7\") pod \"prometheus-k8s-0\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.700606 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.700525    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:15.798922 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.798878    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:15.801185 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:15.801161    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:16.094134 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:16.094099    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 15:17:16.353490 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:17:16.353422    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45ff545d_3c71_4e63_a0d6_1d508eabdba5.slice/crio-d4c1f1a6ff84714e354b8c9b57bd3f1bbd45ed9c5212f5f6ec69b553de567ed6 WatchSource:0}: Error finding container d4c1f1a6ff84714e354b8c9b57bd3f1bbd45ed9c5212f5f6ec69b553de567ed6: Status 404 returned error can't find the container with id d4c1f1a6ff84714e354b8c9b57bd3f1bbd45ed9c5212f5f6ec69b553de567ed6
Sep 19 15:17:16.378562 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:16.378532    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69899b565c-ws9ww" event={"ID":"50f84e90-e76b-4abe-a06b-b8f5c0b4da49","Type":"ContainerStarted","Data":"c4285835ce246d6502d9af492c132f62dac1accc82d7f19c553288fbb92a73c3"}
Sep 19 15:17:16.379838 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:16.379815    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45ff545d-3c71-4e63-a0d6-1d508eabdba5","Type":"ContainerStarted","Data":"d4c1f1a6ff84714e354b8c9b57bd3f1bbd45ed9c5212f5f6ec69b553de567ed6"}
Sep 19 15:17:16.382026 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:16.382006    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64d7d46d-d4299" event={"ID":"c2ef1642-31c5-4f40-8944-5a286a50ef27","Type":"ContainerStarted","Data":"9b855671e348795bdf17ac2c657b5d33c0dfaea35b615fedeb1658bf625f1b45"}
Sep 19 15:17:16.382109 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:16.382056    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64d7d46d-d4299" event={"ID":"c2ef1642-31c5-4f40-8944-5a286a50ef27","Type":"ContainerStarted","Data":"2c327a4ecfd0352c66dbf40bb89e2d050cc405a7a1b1d2416857c13013b3a761"}
Sep 19 15:17:16.382109 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:16.382080    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64d7d46d-d4299" event={"ID":"c2ef1642-31c5-4f40-8944-5a286a50ef27","Type":"ContainerStarted","Data":"c17f80a560fa65d98acd0bcdcbe8c0ec3f65f2a737f4a4b55bfd9a926a065cd2"}
Sep 19 15:17:16.393946 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:16.393904    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69899b565c-ws9ww" podStartSLOduration=2.393889504 podStartE2EDuration="2.393889504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:17:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:17:16.392843795 +0000 UTC m=+299.556258836" watchObservedRunningTime="2026-09-19 15:17:16.393889504 +0000 UTC m=+299.557304540"
Sep 19 15:17:17.330563 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:17.330427    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-45sbs"
Sep 19 15:17:18.010775 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:17.444306    2562 kubelet.go:1648] "Image garbage collection succeeded"
Sep 19 15:17:18.103268 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:18.103245    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:18.205047 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:18.205020    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:18.391946 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:18.391922    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64d7d46d-d4299" event={"ID":"c2ef1642-31c5-4f40-8944-5a286a50ef27","Type":"ContainerStarted","Data":"85f91d5aad781f684182c1891ae6e11442a83c7ac573567b10f2dee61a8999b8"}
Sep 19 15:17:18.392042 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:18.392025    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64d7d46d-d4299" event={"ID":"c2ef1642-31c5-4f40-8944-5a286a50ef27","Type":"ContainerStarted","Data":"7fd7195d95c911364219f6f700fc4ee302345e4561be84c63674f6697a6765fc"}
Sep 19 15:17:18.392094 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:18.392065    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:18.392135 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:18.392091    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64d7d46d-d4299" event={"ID":"c2ef1642-31c5-4f40-8944-5a286a50ef27","Type":"ContainerStarted","Data":"099cb5456ed5da37cff330110e3eea260f20658ca0c0fb35b06339f31f33027d"}
Sep 19 15:17:18.393454 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:18.393424    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-j6f45" event={"ID":"93247531-532a-4d98-bb85-9b6a44dfbbf7","Type":"ContainerStarted","Data":"5efe9af464486acd64b74c1c62f4c0de10456d45510421732dc2bdfd9f14c333"}
Sep 19 15:17:18.393578 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:18.393479    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-j6f45"
Sep 19 15:17:18.394865 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:18.394842    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r" event={"ID":"396db92b-0d94-47e8-a410-d93b0d36c994","Type":"ContainerStarted","Data":"6207c72b9f5d999d258e7ec9658674481f05dbbbc23b502b8c3804a51945b069"}
Sep 19 15:17:18.396494 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:18.396472    2562 generic.go:356] "Generic (PLEG): container finished" podID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerID="907818a46bfcdb42175b76f416f955e0cf0db7a19a2b39fdfbad8e7d95c67fd6" exitCode=0
Sep 19 15:17:18.396605 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:18.396504    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45ff545d-3c71-4e63-a0d6-1d508eabdba5","Type":"ContainerDied","Data":"907818a46bfcdb42175b76f416f955e0cf0db7a19a2b39fdfbad8e7d95c67fd6"}
Sep 19 15:17:18.397628 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:18.397615    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 15:17:18.398568 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:18.398552    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-j6f45"
Sep 19 15:17:18.412502 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:18.412455    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-64d7d46d-d4299" podStartSLOduration=1.803432088 podStartE2EDuration="6.412439964s" totalImagesPullingTime="4.609007876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:17:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:17:18.41063125 +0000 UTC m=+301.574046317" watchObservedRunningTime="2026-09-19 15:17:18.412439964 +0000 UTC m=+301.575855006"
Sep 19 15:17:18.425043 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:18.425011    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r" podStartSLOduration=2.271201184 podStartE2EDuration="5.424999705s" totalImagesPullingTime="3.153798521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:17:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:17:18.424921825 +0000 UTC m=+301.588336875" watchObservedRunningTime="2026-09-19 15:17:18.424999705 +0000 UTC m=+301.588414744"
Sep 19 15:17:18.438022 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:18.437990    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-j6f45" podStartSLOduration=2.364114042 podStartE2EDuration="4.43797928s" totalImagesPullingTime="2.073865238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:17:18.437151921 +0000 UTC m=+301.600566988" watchObservedRunningTime="2026-09-19 15:17:18.43797928 +0000 UTC m=+301.601394356"
Sep 19 15:17:22.419047 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:22.419018    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45ff545d-3c71-4e63-a0d6-1d508eabdba5","Type":"ContainerStarted","Data":"7e4f93e55a4b973f52a4f8b6154fa176c6b50a4e9b3557570522f1a7d6a8cf71"}
Sep 19 15:17:22.419711 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:22.419688    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45ff545d-3c71-4e63-a0d6-1d508eabdba5","Type":"ContainerStarted","Data":"a207c65a2000e03ef504e1f37f937b3ec99487d965a3da1f13f89974674c31db"}
Sep 19 15:17:23.427934 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:23.427904    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45ff545d-3c71-4e63-a0d6-1d508eabdba5","Type":"ContainerStarted","Data":"d68dc96f241d2381c241870a69ba0b52b06b866f27785b3571ab661c4f3f9ec1"}
Sep 19 15:17:23.428397 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:23.427961    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45ff545d-3c71-4e63-a0d6-1d508eabdba5","Type":"ContainerStarted","Data":"e1358c292348761dad7de52d717ab6463de21a69e530e386487623e6e6e19775"}
Sep 19 15:17:23.428397 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:23.427987    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45ff545d-3c71-4e63-a0d6-1d508eabdba5","Type":"ContainerStarted","Data":"bb5dcb227c373fed84de91b4cb9f06088fc5cf352f0839f63896d23d417b108f"}
Sep 19 15:17:23.428397 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:23.428009    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45ff545d-3c71-4e63-a0d6-1d508eabdba5","Type":"ContainerStarted","Data":"3ffb790ed8e83aae4a97ce5ff07bfca26f76056c5cfca8865c099a4470bef613"}
Sep 19 15:17:23.455114 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:23.455065    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.886307795 podStartE2EDuration="8.455049841s" totalImagesPullingTime="5.553934468s" totalInitContainerRuntime="14.807578ms" isStatefulPod=false podCreationTimestamp="2026-09-19 15:17:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:17:23.45254742 +0000 UTC m=+306.615962493" watchObservedRunningTime="2026-09-19 15:17:23.455049841 +0000 UTC m=+306.618464880"
Sep 19 15:17:24.406480 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:24.406450    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-64d7d46d-d4299"
Sep 19 15:17:24.667131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:24.667054    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:24.667131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:24.667113    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:24.671798 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:24.671775    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:24.676450 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:24.676432    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:24.777066 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:24.777034    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:25.147327 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:25.147299    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:25.248442 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:25.248412    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:25.338701 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:25.338672    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:17:25.439434 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:25.439365    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:17:25.479155 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:25.479126    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55b45644bc-c6mxt"]
Sep 19 15:17:25.574460 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:25.574435    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:25.676623 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:25.676594    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:25.775782 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:25.775719    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:25.799569 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:25.799548    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:17:26.447415 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:26.447381    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:26.553784 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:26.553740    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:33.944945 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:33.944912    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:33.945339 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:33.944966    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:34.167413 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:34.167379    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:34.216015 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:34.215949    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:38.492173 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:38.492117    2562 generic.go:356] "Generic (PLEG): container finished" podID="36c16f0e-c336-42e7-a0c4-017c64d092c1" containerID="dd617b897fa7de4f356f6d8ce4916034434163c6367714065d4ef28ee94ce507" exitCode=0
Sep 19 15:17:38.493581 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:38.492821    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj" event={"ID":"36c16f0e-c336-42e7-a0c4-017c64d092c1","Type":"ContainerDied","Data":"dd617b897fa7de4f356f6d8ce4916034434163c6367714065d4ef28ee94ce507"}
Sep 19 15:17:38.493581 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:38.493306    2562 scope.go:117] "RemoveContainer" containerID="dd617b897fa7de4f356f6d8ce4916034434163c6367714065d4ef28ee94ce507"
Sep 19 15:17:39.320810 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.320772    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-844489c87-76mgn" podUID="f2ee2bba-442c-477c-bef6-fdb3bf517bab" containerName="console" containerID="cri-o://6c185e15967b02490c13abd9850c15d5752da29f102e7e49f30c9c56895691da" gracePeriod=15
Sep 19 15:17:39.499643 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.499616    2562 generic.go:356] "Generic (PLEG): container finished" podID="f2ee2bba-442c-477c-bef6-fdb3bf517bab" containerID="6c185e15967b02490c13abd9850c15d5752da29f102e7e49f30c9c56895691da" exitCode=0
Sep 19 15:17:39.500033 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.499694    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844489c87-76mgn" event={"ID":"f2ee2bba-442c-477c-bef6-fdb3bf517bab","Type":"ContainerDied","Data":"6c185e15967b02490c13abd9850c15d5752da29f102e7e49f30c9c56895691da"}
Sep 19 15:17:39.502049 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.502021    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-4gdqj" event={"ID":"36c16f0e-c336-42e7-a0c4-017c64d092c1","Type":"ContainerStarted","Data":"fb5bc6695362ede98081a32b73e2a5c00dc2d540075fe1fa7381a64e5d7aaaf5"}
Sep 19 15:17:39.647549 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.647172    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:17:39.683942 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.683874    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjvc5\" (UniqueName: \"kubernetes.io/projected/f2ee2bba-442c-477c-bef6-fdb3bf517bab-kube-api-access-vjvc5\") pod \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") "
Sep 19 15:17:39.683942 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.683916    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-service-ca\") pod \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") "
Sep 19 15:17:39.683942 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.683943    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-serving-cert\") pod \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") "
Sep 19 15:17:39.684256 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.683981    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-oauth-config\") pod \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") "
Sep 19 15:17:39.684256 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.684025    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-config\") pod \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") "
Sep 19 15:17:39.684256 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.684115    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-trusted-ca-bundle\") pod \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") "
Sep 19 15:17:39.684256 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.684143    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-oauth-serving-cert\") pod \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\" (UID: \"f2ee2bba-442c-477c-bef6-fdb3bf517bab\") "
Sep 19 15:17:39.684559 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.684526    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-config" (OuterVolumeSpecName: "console-config") pod "f2ee2bba-442c-477c-bef6-fdb3bf517bab" (UID: "f2ee2bba-442c-477c-bef6-fdb3bf517bab"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:17:39.684672 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.684653    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-service-ca" (OuterVolumeSpecName: "service-ca") pod "f2ee2bba-442c-477c-bef6-fdb3bf517bab" (UID: "f2ee2bba-442c-477c-bef6-fdb3bf517bab"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:17:39.684736 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.684688    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f2ee2bba-442c-477c-bef6-fdb3bf517bab" (UID: "f2ee2bba-442c-477c-bef6-fdb3bf517bab"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:17:39.684792 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.684737    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f2ee2bba-442c-477c-bef6-fdb3bf517bab" (UID: "f2ee2bba-442c-477c-bef6-fdb3bf517bab"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:17:39.687226 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.686752    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f2ee2bba-442c-477c-bef6-fdb3bf517bab" (UID: "f2ee2bba-442c-477c-bef6-fdb3bf517bab"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:17:39.687226 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.686763    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f2ee2bba-442c-477c-bef6-fdb3bf517bab" (UID: "f2ee2bba-442c-477c-bef6-fdb3bf517bab"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:17:39.687226 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.686787    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2ee2bba-442c-477c-bef6-fdb3bf517bab-kube-api-access-vjvc5" (OuterVolumeSpecName: "kube-api-access-vjvc5") pod "f2ee2bba-442c-477c-bef6-fdb3bf517bab" (UID: "f2ee2bba-442c-477c-bef6-fdb3bf517bab"). InnerVolumeSpecName "kube-api-access-vjvc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:17:39.785191 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.785154    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjvc5\" (UniqueName: \"kubernetes.io/projected/f2ee2bba-442c-477c-bef6-fdb3bf517bab-kube-api-access-vjvc5\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:39.785191 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.785187    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:39.785191 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.785214    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-serving-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:39.785440 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.785227    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-oauth-config\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:39.785440 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.785236    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-console-config\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:39.785440 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.785245    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-trusted-ca-bundle\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:39.785440 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:39.785252    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2ee2bba-442c-477c-bef6-fdb3bf517bab-oauth-serving-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:40.507768 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:40.507738    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844489c87-76mgn"
Sep 19 15:17:40.507768 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:40.507760    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844489c87-76mgn" event={"ID":"f2ee2bba-442c-477c-bef6-fdb3bf517bab","Type":"ContainerDied","Data":"fdfde1f4812671189ca246d4ffa5f6e365d7f770c895eecf85331de1d9aaf19a"}
Sep 19 15:17:40.508274 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:40.507822    2562 scope.go:117] "RemoveContainer" containerID="6c185e15967b02490c13abd9850c15d5752da29f102e7e49f30c9c56895691da"
Sep 19 15:17:40.529807 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:40.529770    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-844489c87-76mgn"]
Sep 19 15:17:40.531064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:40.531043    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-844489c87-76mgn"]
Sep 19 15:17:41.343524 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:41.343493    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2ee2bba-442c-477c-bef6-fdb3bf517bab" path="/var/lib/kubelet/pods/f2ee2bba-442c-477c-bef6-fdb3bf517bab/volumes"
Sep 19 15:17:41.450388 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:41.450365    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:41.505277 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:41.505253    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:17:50.499889 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.499845    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55b45644bc-c6mxt" podUID="0afa330c-a6e6-4a2c-adf0-f33c7f7616f2" containerName="console" containerID="cri-o://53ff729170d2d7262fbf84be439d44f035042042ef278ad754f9165db72f14b4" gracePeriod=15
Sep 19 15:17:50.775683 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.775633    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:17:50.869063 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.869040    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-config\") pod \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") "
Sep 19 15:17:50.869186 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.869095    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-serving-cert\") pod \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") "
Sep 19 15:17:50.869186 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.869116    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24bvr\" (UniqueName: \"kubernetes.io/projected/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-kube-api-access-24bvr\") pod \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") "
Sep 19 15:17:50.869186 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.869134    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-oauth-serving-cert\") pod \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") "
Sep 19 15:17:50.869186 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.869151    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-oauth-config\") pod \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") "
Sep 19 15:17:50.869186 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.869176    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-service-ca\") pod \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\" (UID: \"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2\") "
Sep 19 15:17:50.869554 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.869531    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-config" (OuterVolumeSpecName: "console-config") pod "0afa330c-a6e6-4a2c-adf0-f33c7f7616f2" (UID: "0afa330c-a6e6-4a2c-adf0-f33c7f7616f2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:17:50.869663 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.869572    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0afa330c-a6e6-4a2c-adf0-f33c7f7616f2" (UID: "0afa330c-a6e6-4a2c-adf0-f33c7f7616f2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:17:50.869663 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.869597    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-service-ca" (OuterVolumeSpecName: "service-ca") pod "0afa330c-a6e6-4a2c-adf0-f33c7f7616f2" (UID: "0afa330c-a6e6-4a2c-adf0-f33c7f7616f2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:17:50.871396 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.871369    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-kube-api-access-24bvr" (OuterVolumeSpecName: "kube-api-access-24bvr") pod "0afa330c-a6e6-4a2c-adf0-f33c7f7616f2" (UID: "0afa330c-a6e6-4a2c-adf0-f33c7f7616f2"). InnerVolumeSpecName "kube-api-access-24bvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:17:50.871470 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.871437    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0afa330c-a6e6-4a2c-adf0-f33c7f7616f2" (UID: "0afa330c-a6e6-4a2c-adf0-f33c7f7616f2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:17:50.871470 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.871464    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0afa330c-a6e6-4a2c-adf0-f33c7f7616f2" (UID: "0afa330c-a6e6-4a2c-adf0-f33c7f7616f2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:17:50.970501 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.970479    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:50.970501 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.970498    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-config\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:50.970615 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.970507    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-serving-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:50.970615 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.970516    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24bvr\" (UniqueName: \"kubernetes.io/projected/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-kube-api-access-24bvr\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:50.970615 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.970524    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-oauth-serving-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:50.970615 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:50.970532    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2-console-oauth-config\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:17:51.553819 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:51.553787    2562 generic.go:356] "Generic (PLEG): container finished" podID="0afa330c-a6e6-4a2c-adf0-f33c7f7616f2" containerID="53ff729170d2d7262fbf84be439d44f035042042ef278ad754f9165db72f14b4" exitCode=0
Sep 19 15:17:51.554265 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:51.553829    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55b45644bc-c6mxt"
Sep 19 15:17:51.554265 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:51.553877    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55b45644bc-c6mxt" event={"ID":"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2","Type":"ContainerDied","Data":"53ff729170d2d7262fbf84be439d44f035042042ef278ad754f9165db72f14b4"}
Sep 19 15:17:51.554265 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:51.553925    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55b45644bc-c6mxt" event={"ID":"0afa330c-a6e6-4a2c-adf0-f33c7f7616f2","Type":"ContainerDied","Data":"eeaf82224e3060699e661bc63c02028bb254eca7200995d7cb3179cdc2b53162"}
Sep 19 15:17:51.554265 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:51.553944    2562 scope.go:117] "RemoveContainer" containerID="53ff729170d2d7262fbf84be439d44f035042042ef278ad754f9165db72f14b4"
Sep 19 15:17:51.561899 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:51.561886    2562 scope.go:117] "RemoveContainer" containerID="53ff729170d2d7262fbf84be439d44f035042042ef278ad754f9165db72f14b4"
Sep 19 15:17:51.562171 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:17:51.562153    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53ff729170d2d7262fbf84be439d44f035042042ef278ad754f9165db72f14b4\": container with ID starting with 53ff729170d2d7262fbf84be439d44f035042042ef278ad754f9165db72f14b4 not found: ID does not exist" containerID="53ff729170d2d7262fbf84be439d44f035042042ef278ad754f9165db72f14b4"
Sep 19 15:17:51.562315 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:51.562183    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53ff729170d2d7262fbf84be439d44f035042042ef278ad754f9165db72f14b4"} err="failed to get container status \"53ff729170d2d7262fbf84be439d44f035042042ef278ad754f9165db72f14b4\": rpc error: code = NotFound desc = could not find container \"53ff729170d2d7262fbf84be439d44f035042042ef278ad754f9165db72f14b4\": container with ID starting with 53ff729170d2d7262fbf84be439d44f035042042ef278ad754f9165db72f14b4 not found: ID does not exist"
Sep 19 15:17:51.568608 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:51.568588    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55b45644bc-c6mxt"]
Sep 19 15:17:51.570525 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:51.570505    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55b45644bc-c6mxt"]
Sep 19 15:17:53.343633 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:53.343588    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0afa330c-a6e6-4a2c-adf0-f33c7f7616f2" path="/var/lib/kubelet/pods/0afa330c-a6e6-4a2c-adf0-f33c7f7616f2/volumes"
Sep 19 15:17:53.953648 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:53.953620    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:17:53.957773 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:17:53.957749    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5c6b474b65-b8v8r"
Sep 19 15:18:15.798996 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:15.798959    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:15.820096 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:15.820067    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:16.672764 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:16.672739    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:22.010537 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:22.010501    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:22.062927 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:22.062902    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:28.474633 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:28.474600    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:28.676370 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:28.676339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:30.688265 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:30.688214    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:30.737711 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:30.737673    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:31.291258 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:31.291218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs\") pod \"network-metrics-daemon-tmbmf\" (UID: \"01ca12cf-99c7-4835-b150-0b653dfc1905\") " pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:18:31.293756 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:31.293735    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ca12cf-99c7-4835-b150-0b653dfc1905-metrics-certs\") pod \"network-metrics-daemon-tmbmf\" (UID: \"01ca12cf-99c7-4835-b150-0b653dfc1905\") " pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:18:31.341303 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:31.341271    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fxxj8\""
Sep 19 15:18:31.349368 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:31.349343    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmbmf"
Sep 19 15:18:31.623839 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:31.623699    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tmbmf"]
Sep 19 15:18:31.626539 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:18:31.626511    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ca12cf_99c7_4835_b150_0b653dfc1905.slice/crio-6fb3ef64af0cb03e03f3b918d4ba76f30736009f4f5eb7d7316d04059c92bce1 WatchSource:0}: Error finding container 6fb3ef64af0cb03e03f3b918d4ba76f30736009f4f5eb7d7316d04059c92bce1: Status 404 returned error can't find the container with id 6fb3ef64af0cb03e03f3b918d4ba76f30736009f4f5eb7d7316d04059c92bce1
Sep 19 15:18:31.718103 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:31.718078    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tmbmf" event={"ID":"01ca12cf-99c7-4835-b150-0b653dfc1905","Type":"ContainerStarted","Data":"6fb3ef64af0cb03e03f3b918d4ba76f30736009f4f5eb7d7316d04059c92bce1"}
Sep 19 15:18:32.724255 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:32.724228    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tmbmf" event={"ID":"01ca12cf-99c7-4835-b150-0b653dfc1905","Type":"ContainerStarted","Data":"17d84b19a284db89cfac4aef843653e36224e9b89aa607966b802638bb22a4a7"}
Sep 19 15:18:32.724683 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:32.724279    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tmbmf" event={"ID":"01ca12cf-99c7-4835-b150-0b653dfc1905","Type":"ContainerStarted","Data":"c8a3c927dd0862b44c7df278c65ea0d873719856f3895afa941fe9ff2182b42e"}
Sep 19 15:18:32.738312 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:32.738268    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tmbmf" podStartSLOduration=373.840956339 podStartE2EDuration="6m14.73825284s" totalImagesPullingTime="897.296501ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:18:32.737063619 +0000 UTC m=+375.900478655" watchObservedRunningTime="2026-09-19 15:18:32.73825284 +0000 UTC m=+375.901667871"
Sep 19 15:18:32.816500 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:32.816470    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:32.884622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:32.884594    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:32.941161 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:32.941137    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:33.821735 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:33.821708    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 15:18:33.822129 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:33.821964    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="prometheus" containerID="cri-o://a207c65a2000e03ef504e1f37f937b3ec99487d965a3da1f13f89974674c31db" gracePeriod=600
Sep 19 15:18:33.822129 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:33.821983    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="kube-rbac-proxy" containerID="cri-o://e1358c292348761dad7de52d717ab6463de21a69e530e386487623e6e6e19775" gracePeriod=600
Sep 19 15:18:33.822129 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:33.822009    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="thanos-sidecar" containerID="cri-o://3ffb790ed8e83aae4a97ce5ff07bfca26f76056c5cfca8865c099a4470bef613" gracePeriod=600
Sep 19 15:18:33.822129 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:33.822023    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="kube-rbac-proxy-web" containerID="cri-o://bb5dcb227c373fed84de91b4cb9f06088fc5cf352f0839f63896d23d417b108f" gracePeriod=600
Sep 19 15:18:33.822129 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:33.822061    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="config-reloader" containerID="cri-o://7e4f93e55a4b973f52a4f8b6154fa176c6b50a4e9b3557570522f1a7d6a8cf71" gracePeriod=600
Sep 19 15:18:33.822129 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:33.822105    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d68dc96f241d2381c241870a69ba0b52b06b866f27785b3571ab661c4f3f9ec1" gracePeriod=600
Sep 19 15:18:34.735752 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:34.735720    2562 generic.go:356] "Generic (PLEG): container finished" podID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerID="bb5dcb227c373fed84de91b4cb9f06088fc5cf352f0839f63896d23d417b108f" exitCode=0
Sep 19 15:18:34.735752 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:34.735744    2562 generic.go:356] "Generic (PLEG): container finished" podID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerID="3ffb790ed8e83aae4a97ce5ff07bfca26f76056c5cfca8865c099a4470bef613" exitCode=0
Sep 19 15:18:34.735752 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:34.735750    2562 generic.go:356] "Generic (PLEG): container finished" podID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerID="7e4f93e55a4b973f52a4f8b6154fa176c6b50a4e9b3557570522f1a7d6a8cf71" exitCode=0
Sep 19 15:18:34.735979 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:34.735795    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45ff545d-3c71-4e63-a0d6-1d508eabdba5","Type":"ContainerDied","Data":"bb5dcb227c373fed84de91b4cb9f06088fc5cf352f0839f63896d23d417b108f"}
Sep 19 15:18:34.735979 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:34.735904    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45ff545d-3c71-4e63-a0d6-1d508eabdba5","Type":"ContainerDied","Data":"3ffb790ed8e83aae4a97ce5ff07bfca26f76056c5cfca8865c099a4470bef613"}
Sep 19 15:18:34.735979 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:34.735941    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45ff545d-3c71-4e63-a0d6-1d508eabdba5","Type":"ContainerDied","Data":"7e4f93e55a4b973f52a4f8b6154fa176c6b50a4e9b3557570522f1a7d6a8cf71"}
Sep 19 15:18:35.743363 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:35.743336    2562 generic.go:356] "Generic (PLEG): container finished" podID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerID="d68dc96f241d2381c241870a69ba0b52b06b866f27785b3571ab661c4f3f9ec1" exitCode=0
Sep 19 15:18:35.743363 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:35.743358    2562 generic.go:356] "Generic (PLEG): container finished" podID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerID="e1358c292348761dad7de52d717ab6463de21a69e530e386487623e6e6e19775" exitCode=0
Sep 19 15:18:35.743748 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:35.743403    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45ff545d-3c71-4e63-a0d6-1d508eabdba5","Type":"ContainerDied","Data":"d68dc96f241d2381c241870a69ba0b52b06b866f27785b3571ab661c4f3f9ec1"}
Sep 19 15:18:35.743748 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:35.743465    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45ff545d-3c71-4e63-a0d6-1d508eabdba5","Type":"ContainerDied","Data":"e1358c292348761dad7de52d717ab6463de21a69e530e386487623e6e6e19775"}
Sep 19 15:18:36.469812 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.469781    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-744cc88f8-rq675"]
Sep 19 15:18:36.470207 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.470182    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2ee2bba-442c-477c-bef6-fdb3bf517bab" containerName="console"
Sep 19 15:18:36.470263 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.470214    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2ee2bba-442c-477c-bef6-fdb3bf517bab" containerName="console"
Sep 19 15:18:36.470263 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.470233    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0afa330c-a6e6-4a2c-adf0-f33c7f7616f2" containerName="console"
Sep 19 15:18:36.470263 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.470240    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0afa330c-a6e6-4a2c-adf0-f33c7f7616f2" containerName="console"
Sep 19 15:18:36.470349 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.470308    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0afa330c-a6e6-4a2c-adf0-f33c7f7616f2" containerName="console"
Sep 19 15:18:36.470349 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.470320    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2ee2bba-442c-477c-bef6-fdb3bf517bab" containerName="console"
Sep 19 15:18:36.472265 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.472249    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.484683 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.484657    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-744cc88f8-rq675"]
Sep 19 15:18:36.524661 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.524621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:36.535939 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.535914    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebd03383-4772-4105-b5f7-44774737f6af-console-oauth-config\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.536053 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.535958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-service-ca\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.536053 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.536015    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebd03383-4772-4105-b5f7-44774737f6af-console-serving-cert\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.536137 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.536051    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhzcp\" (UniqueName: \"kubernetes.io/projected/ebd03383-4772-4105-b5f7-44774737f6af-kube-api-access-bhzcp\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.536137 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.536079    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-console-config\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.536137 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.536102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-oauth-serving-cert\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.536262 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.536152    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-trusted-ca-bundle\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.625134 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.625108    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:36.637360 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.637337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-service-ca\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.637484 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.637381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebd03383-4772-4105-b5f7-44774737f6af-console-serving-cert\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.637484 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.637410    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhzcp\" (UniqueName: \"kubernetes.io/projected/ebd03383-4772-4105-b5f7-44774737f6af-kube-api-access-bhzcp\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.637484 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.637430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-console-config\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.637484 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.637450    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-oauth-serving-cert\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.637484 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.637480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-trusted-ca-bundle\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.637732 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.637536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebd03383-4772-4105-b5f7-44774737f6af-console-oauth-config\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.638104 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.638083    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-service-ca\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.638344 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.638303    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-oauth-serving-cert\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.638518 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.638498    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-console-config\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.639143 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.639123    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-trusted-ca-bundle\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.640236 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.640215    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebd03383-4772-4105-b5f7-44774737f6af-console-serving-cert\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.640323 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.640257    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebd03383-4772-4105-b5f7-44774737f6af-console-oauth-config\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.644657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.644630    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhzcp\" (UniqueName: \"kubernetes.io/projected/ebd03383-4772-4105-b5f7-44774737f6af-kube-api-access-bhzcp\") pod \"console-744cc88f8-rq675\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") " pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:36.659260 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:18:36.659227    2562 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a207c65a2000e03ef504e1f37f937b3ec99487d965a3da1f13f89974674c31db" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Sep 19 15:18:36.660151 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:18:36.660124    2562 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a207c65a2000e03ef504e1f37f937b3ec99487d965a3da1f13f89974674c31db" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Sep 19 15:18:36.661060 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:18:36.661031    2562 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a207c65a2000e03ef504e1f37f937b3ec99487d965a3da1f13f89974674c31db" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Sep 19 15:18:36.661145 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:18:36.661071    2562 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="prometheus" probeResult="unknown"
Sep 19 15:18:36.725368 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.725315    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:36.781393 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:36.781374    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:37.061509 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:37.061480    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-744cc88f8-rq675"]
Sep 19 15:18:37.064400 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:18:37.064374    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd03383_4772_4105_b5f7_44774737f6af.slice/crio-5c95a1d67a6accd475f00170426e67df055cfd87cfe6ef733a63b77cd698588f WatchSource:0}: Error finding container 5c95a1d67a6accd475f00170426e67df055cfd87cfe6ef733a63b77cd698588f: Status 404 returned error can't find the container with id 5c95a1d67a6accd475f00170426e67df055cfd87cfe6ef733a63b77cd698588f
Sep 19 15:18:37.260484 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:37.260435    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:37.362108 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:37.362046    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:37.753117 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:37.753047    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744cc88f8-rq675" event={"ID":"ebd03383-4772-4105-b5f7-44774737f6af","Type":"ContainerStarted","Data":"ec19b65c310f9c18d33f3d6df218766fc371ebd1712381060c6f7552d1f53ba8"}
Sep 19 15:18:37.753117 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:37.753090    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744cc88f8-rq675" event={"ID":"ebd03383-4772-4105-b5f7-44774737f6af","Type":"ContainerStarted","Data":"5c95a1d67a6accd475f00170426e67df055cfd87cfe6ef733a63b77cd698588f"}
Sep 19 15:18:37.769931 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:37.769879    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-744cc88f8-rq675" podStartSLOduration=1.76986022 podStartE2EDuration="1.76986022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:18:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:18:37.768145312 +0000 UTC m=+380.931560351" watchObservedRunningTime="2026-09-19 15:18:37.76986022 +0000 UTC m=+380.933275259"
Sep 19 15:18:41.659509 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:18:41.659465    2562 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a207c65a2000e03ef504e1f37f937b3ec99487d965a3da1f13f89974674c31db" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Sep 19 15:18:41.660517 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:18:41.660486    2562 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a207c65a2000e03ef504e1f37f937b3ec99487d965a3da1f13f89974674c31db" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Sep 19 15:18:41.661473 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:18:41.661443    2562 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a207c65a2000e03ef504e1f37f937b3ec99487d965a3da1f13f89974674c31db" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Sep 19 15:18:41.661549 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:18:41.661483    2562 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="prometheus" probeResult="unknown"
Sep 19 15:18:41.774616 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.774586    2562 generic.go:356] "Generic (PLEG): container finished" podID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerID="a207c65a2000e03ef504e1f37f937b3ec99487d965a3da1f13f89974674c31db" exitCode=0
Sep 19 15:18:41.774767 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.774660    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45ff545d-3c71-4e63-a0d6-1d508eabdba5","Type":"ContainerDied","Data":"a207c65a2000e03ef504e1f37f937b3ec99487d965a3da1f13f89974674c31db"}
Sep 19 15:18:41.866412 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.866388    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:41.879458 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.879435    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-kubelet-serving-ca-bundle\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.879576 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.879463    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-metrics-client-certs\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.879576 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.879485    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-1\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.879576 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.879510    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-metrics-client-ca\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.879576 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.879544    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-serving-certs-ca-bundle\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.879576 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.879575    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45ff545d-3c71-4e63-a0d6-1d508eabdba5-tls-assets\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.879864 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.879603    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-2\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.879864 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.879732    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-db\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.879864 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.879779    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-thanos-prometheus-http-client-file\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.879864 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.879804    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:18:41.879864 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.879811    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcsk7\" (UniqueName: \"kubernetes.io/projected/45ff545d-3c71-4e63-a0d6-1d508eabdba5-kube-api-access-dcsk7\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.879864 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.879836    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.879864 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.879866    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-tls\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.880417 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.879907    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.880417 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.879932    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45ff545d-3c71-4e63-a0d6-1d508eabdba5-config-out\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.880417 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.879963    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-config\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.880417 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.880021    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-trusted-ca-bundle\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.880417 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.880047    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-grpc-tls\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.880417 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.880075    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-kube-rbac-proxy\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.880417 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.880080    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:18:41.880417 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.880106    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-web-config\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.880417 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.880124    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:18:41.880417 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.880133    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-0\") pod \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\" (UID: \"45ff545d-3c71-4e63-a0d6-1d508eabdba5\") "
Sep 19 15:18:41.880417 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.880381    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:18:41.880417 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.880419    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:18:41.881013 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.880624    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.881013 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.880648    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.881013 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.880664    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.881013 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.880680    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.881013 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.880703    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-configmap-metrics-client-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.881276 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.881130    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:18:41.881514 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.881493    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:18:41.882041 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.882011    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:18:41.882631 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.882593    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:18:41.882810 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.882783    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45ff545d-3c71-4e63-a0d6-1d508eabdba5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:18:41.882924 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.882882    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:18:41.883622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.883587    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:18:41.884853 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.884814    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:18:41.885061 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.885018    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:18:41.885151 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.885108    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:18:41.885331 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.885298    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:18:41.885423 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.885382    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45ff545d-3c71-4e63-a0d6-1d508eabdba5-config-out" (OuterVolumeSpecName: "config-out") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:18:41.885702 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.885672    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45ff545d-3c71-4e63-a0d6-1d508eabdba5-kube-api-access-dcsk7" (OuterVolumeSpecName: "kube-api-access-dcsk7") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "kube-api-access-dcsk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:18:41.886312 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.886297    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-config" (OuterVolumeSpecName: "config") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:18:41.901024 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.900996    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-web-config" (OuterVolumeSpecName: "web-config") pod "45ff545d-3c71-4e63-a0d6-1d508eabdba5" (UID: "45ff545d-3c71-4e63-a0d6-1d508eabdba5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:18:41.981696 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.981624    2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-metrics-client-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.981696 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.981648    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45ff545d-3c71-4e63-a0d6-1d508eabdba5-tls-assets\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.981696 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.981658    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-db\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.981696 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.981668    2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.981696 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.981679    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcsk7\" (UniqueName: \"kubernetes.io/projected/45ff545d-3c71-4e63-a0d6-1d508eabdba5-kube-api-access-dcsk7\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.981696 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.981688    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.981696 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.981697    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.981978 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.981705    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.981978 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.981713    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45ff545d-3c71-4e63-a0d6-1d508eabdba5-config-out\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.981978 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.981721    2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-config\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.981978 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.981728    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.981978 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.981735    2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-grpc-tls\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.981978 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.981743    2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-secret-kube-rbac-proxy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.981978 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.981750    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45ff545d-3c71-4e63-a0d6-1d508eabdba5-web-config\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:41.981978 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:41.981758    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45ff545d-3c71-4e63-a0d6-1d508eabdba5-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:18:42.784336 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.784297    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45ff545d-3c71-4e63-a0d6-1d508eabdba5","Type":"ContainerDied","Data":"d4c1f1a6ff84714e354b8c9b57bd3f1bbd45ed9c5212f5f6ec69b553de567ed6"}
Sep 19 15:18:42.784766 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.784444    2562 scope.go:117] "RemoveContainer" containerID="d68dc96f241d2381c241870a69ba0b52b06b866f27785b3571ab661c4f3f9ec1"
Sep 19 15:18:42.784766 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.784738    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.793678 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.793655    2562 scope.go:117] "RemoveContainer" containerID="e1358c292348761dad7de52d717ab6463de21a69e530e386487623e6e6e19775"
Sep 19 15:18:42.801823 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.801806    2562 scope.go:117] "RemoveContainer" containerID="bb5dcb227c373fed84de91b4cb9f06088fc5cf352f0839f63896d23d417b108f"
Sep 19 15:18:42.809394 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.809373    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 15:18:42.809466 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.809409    2562 scope.go:117] "RemoveContainer" containerID="3ffb790ed8e83aae4a97ce5ff07bfca26f76056c5cfca8865c099a4470bef613"
Sep 19 15:18:42.812824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.812803    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 15:18:42.816547 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.816531    2562 scope.go:117] "RemoveContainer" containerID="7e4f93e55a4b973f52a4f8b6154fa176c6b50a4e9b3557570522f1a7d6a8cf71"
Sep 19 15:18:42.823250 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.823234    2562 scope.go:117] "RemoveContainer" containerID="a207c65a2000e03ef504e1f37f937b3ec99487d965a3da1f13f89974674c31db"
Sep 19 15:18:42.830551 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.830535    2562 scope.go:117] "RemoveContainer" containerID="907818a46bfcdb42175b76f416f955e0cf0db7a19a2b39fdfbad8e7d95c67fd6"
Sep 19 15:18:42.835370 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835353    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 15:18:42.835613 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835603    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="config-reloader"
Sep 19 15:18:42.835654 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835615    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="config-reloader"
Sep 19 15:18:42.835654 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835626    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="init-config-reloader"
Sep 19 15:18:42.835654 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835632    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="init-config-reloader"
Sep 19 15:18:42.835654 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835639    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="prometheus"
Sep 19 15:18:42.835654 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835644    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="prometheus"
Sep 19 15:18:42.835654 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835654    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="kube-rbac-proxy-web"
Sep 19 15:18:42.835818 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835659    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="kube-rbac-proxy-web"
Sep 19 15:18:42.835818 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835665    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="kube-rbac-proxy"
Sep 19 15:18:42.835818 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835670    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="kube-rbac-proxy"
Sep 19 15:18:42.835818 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835683    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="thanos-sidecar"
Sep 19 15:18:42.835818 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835688    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="thanos-sidecar"
Sep 19 15:18:42.835818 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835694    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="kube-rbac-proxy-thanos"
Sep 19 15:18:42.835818 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835699    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="kube-rbac-proxy-thanos"
Sep 19 15:18:42.835818 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835745    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="kube-rbac-proxy-thanos"
Sep 19 15:18:42.835818 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835753    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="config-reloader"
Sep 19 15:18:42.835818 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835758    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="prometheus"
Sep 19 15:18:42.835818 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835764    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="thanos-sidecar"
Sep 19 15:18:42.835818 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835771    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="kube-rbac-proxy-web"
Sep 19 15:18:42.835818 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.835777    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" containerName="kube-rbac-proxy"
Sep 19 15:18:42.838690 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.838676    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.841067 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.841047    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 19 15:18:42.841154 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.841049    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 19 15:18:42.841154 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.841053    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 19 15:18:42.841757 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.841740    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 19 15:18:42.841811 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.841803    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 19 15:18:42.842017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.842004    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 19 15:18:42.842091 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.842033    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 19 15:18:42.842174 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.842162    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 19 15:18:42.842354 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.842335    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 19 15:18:42.842354 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.842360    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 19 15:18:42.842517 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.842358    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 19 15:18:42.842517 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.842361    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 19 15:18:42.842966 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.842954    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-45shiu3c8jn30\""
Sep 19 15:18:42.843598 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.843568    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fchm2\""
Sep 19 15:18:42.845516 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.845496    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 19 15:18:42.848561 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.848544    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 19 15:18:42.880393 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.880375    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 15:18:42.887812 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.887783    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.887871 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.887823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.887871 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.887848    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.887945 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.887880    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9606391d-496b-4595-bcc5-b8c826a45c1a-config-out\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.887945 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.887909    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.887945 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.887922    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.888032 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.887977    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f2lb\" (UniqueName: \"kubernetes.io/projected/9606391d-496b-4595-bcc5-b8c826a45c1a-kube-api-access-6f2lb\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.888032 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.887999    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-web-config\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.888032 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.888015    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.888119 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.888063    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.888119 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.888084    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.888174 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.888128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.888174 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.888145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.888174 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.888159    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.888311 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.888182    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9606391d-496b-4595-bcc5-b8c826a45c1a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.888311 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.888216    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9606391d-496b-4595-bcc5-b8c826a45c1a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.888311 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.888245    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.888311 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.888278    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.888311 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.888293    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.888311 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.888310    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-config\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.988954 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.988884    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.988954 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.988919    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.988954 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.988947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-config\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989152 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989070    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989152 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989114    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989292 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989158    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989292 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9606391d-496b-4595-bcc5-b8c826a45c1a-config-out\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989292 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989242    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989292 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989264    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989496 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989296    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f2lb\" (UniqueName: \"kubernetes.io/projected/9606391d-496b-4595-bcc5-b8c826a45c1a-kube-api-access-6f2lb\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989496 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989334    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-web-config\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989496 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989360    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989496 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989389    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989496 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989417    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989496 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989496 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989987 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989512    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989987 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989539    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9606391d-496b-4595-bcc5-b8c826a45c1a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989987 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989566    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9606391d-496b-4595-bcc5-b8c826a45c1a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989987 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989576    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.989987 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.989601    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.990307 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.990000    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.990307 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.990154    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.990307 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.990300    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.990836 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.990703    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9606391d-496b-4595-bcc5-b8c826a45c1a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.991148 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.991105    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.991476 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.991452    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.993270 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.993249    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.993516 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.993490    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.994417 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.994006    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.994417 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.994253    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-config\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.994417 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.994367    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.994588 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.994501    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.994588 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.994527    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-web-config\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.994718 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.994692    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.995062 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.995037    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9606391d-496b-4595-bcc5-b8c826a45c1a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.995147 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.995086    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9606391d-496b-4595-bcc5-b8c826a45c1a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.995501 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.995481    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9606391d-496b-4595-bcc5-b8c826a45c1a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.996077 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.996055    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9606391d-496b-4595-bcc5-b8c826a45c1a-config-out\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:42.997157 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:42.997141    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f2lb\" (UniqueName: \"kubernetes.io/projected/9606391d-496b-4595-bcc5-b8c826a45c1a-kube-api-access-6f2lb\") pod \"prometheus-k8s-0\" (UID: \"9606391d-496b-4595-bcc5-b8c826a45c1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:43.148863 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:43.148829    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:43.343023 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:43.342993    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45ff545d-3c71-4e63-a0d6-1d508eabdba5" path="/var/lib/kubelet/pods/45ff545d-3c71-4e63-a0d6-1d508eabdba5/volumes"
Sep 19 15:18:43.426972 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:43.426938    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 15:18:43.428850 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:18:43.428824    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9606391d_496b_4595_bcc5_b8c826a45c1a.slice/crio-fdcd64509e5ff99ead1d0b67ca1d8ebebe256d1e5835854d2b703f7c570699d5 WatchSource:0}: Error finding container fdcd64509e5ff99ead1d0b67ca1d8ebebe256d1e5835854d2b703f7c570699d5: Status 404 returned error can't find the container with id fdcd64509e5ff99ead1d0b67ca1d8ebebe256d1e5835854d2b703f7c570699d5
Sep 19 15:18:43.790979 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:43.790951    2562 generic.go:356] "Generic (PLEG): container finished" podID="9606391d-496b-4595-bcc5-b8c826a45c1a" containerID="35cd166284370b8869f49c03bb1103db1968139e723c5fb57e2ebb36312a2343" exitCode=0
Sep 19 15:18:43.791315 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:43.791025    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9606391d-496b-4595-bcc5-b8c826a45c1a","Type":"ContainerDied","Data":"35cd166284370b8869f49c03bb1103db1968139e723c5fb57e2ebb36312a2343"}
Sep 19 15:18:43.791315 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:43.791083    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9606391d-496b-4595-bcc5-b8c826a45c1a","Type":"ContainerStarted","Data":"fdcd64509e5ff99ead1d0b67ca1d8ebebe256d1e5835854d2b703f7c570699d5"}
Sep 19 15:18:44.799032 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:44.798992    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9606391d-496b-4595-bcc5-b8c826a45c1a","Type":"ContainerStarted","Data":"a9d9c37d7f90063b25333f1602c1900b0b65b7cf61e1ec72407145052fe3797c"}
Sep 19 15:18:44.799401 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:44.799096    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9606391d-496b-4595-bcc5-b8c826a45c1a","Type":"ContainerStarted","Data":"8c2cd986bb54006eccc11f07395c25e71ae80ada3dbf5fedd62f562392d57787"}
Sep 19 15:18:44.799401 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:44.799124    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9606391d-496b-4595-bcc5-b8c826a45c1a","Type":"ContainerStarted","Data":"caeac00f642dc2d609ce295d61c916fb82536246d765ecaec45e25c28cb85422"}
Sep 19 15:18:44.799401 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:44.799148    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9606391d-496b-4595-bcc5-b8c826a45c1a","Type":"ContainerStarted","Data":"cb2bf93ac9632bbf5b7a1a731b179485f52d09b812f22b7f365f9acf4999f9dc"}
Sep 19 15:18:44.799401 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:44.799172    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9606391d-496b-4595-bcc5-b8c826a45c1a","Type":"ContainerStarted","Data":"74e75689ee973dcc8ef22669d27b8c04814465ef10728341528dd98420a19ac1"}
Sep 19 15:18:44.799401 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:44.799219    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9606391d-496b-4595-bcc5-b8c826a45c1a","Type":"ContainerStarted","Data":"0d91b226655a5737195fd7447321432edc0221852e365e542b3a83fbc7f1425e"}
Sep 19 15:18:44.825443 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:44.825396    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.807869955 podStartE2EDuration="2.8253788s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.508845ms" isStatefulPod=false podCreationTimestamp="2026-09-19 15:18:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:18:44.823554533 +0000 UTC m=+387.986969615" watchObservedRunningTime="2026-09-19 15:18:44.8253788 +0000 UTC m=+387.988793841"
Sep 19 15:18:46.782447 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:46.782411    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:46.782851 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:46.782482    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:46.787072 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:46.787052    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:46.810999 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:46.810977    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:18:46.855955 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:46.855920    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69899b565c-ws9ww"]
Sep 19 15:18:46.945450 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:46.945414    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:46.994024 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:46.993992    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:47.049158 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:47.049129    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:47.099146 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:47.099117    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:48.149709 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:48.149673    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:18:55.906756 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:55.906721    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:18:55.952438 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:18:55.952409    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:19:11.877768 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:11.877725    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69899b565c-ws9ww" podUID="50f84e90-e76b-4abe-a06b-b8f5c0b4da49" containerName="console" containerID="cri-o://c4285835ce246d6502d9af492c132f62dac1accc82d7f19c553288fbb92a73c3" gracePeriod=15
Sep 19 15:19:12.112217 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.112180    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:19:12.200516 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.200449    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-service-ca\") pod \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") "
Sep 19 15:19:12.200516 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.200482    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-oauth-config\") pod \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") "
Sep 19 15:19:12.200674 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.200525    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-trusted-ca-bundle\") pod \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") "
Sep 19 15:19:12.200674 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.200587    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-oauth-serving-cert\") pod \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") "
Sep 19 15:19:12.200674 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.200624    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-serving-cert\") pod \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") "
Sep 19 15:19:12.200674 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.200660    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-config\") pod \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") "
Sep 19 15:19:12.200879 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.200691    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4l2h\" (UniqueName: \"kubernetes.io/projected/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-kube-api-access-j4l2h\") pod \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\" (UID: \"50f84e90-e76b-4abe-a06b-b8f5c0b4da49\") "
Sep 19 15:19:12.200947 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.200920    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-service-ca" (OuterVolumeSpecName: "service-ca") pod "50f84e90-e76b-4abe-a06b-b8f5c0b4da49" (UID: "50f84e90-e76b-4abe-a06b-b8f5c0b4da49"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:19:12.201153 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.200954    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "50f84e90-e76b-4abe-a06b-b8f5c0b4da49" (UID: "50f84e90-e76b-4abe-a06b-b8f5c0b4da49"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:19:12.201153 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.200984    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "50f84e90-e76b-4abe-a06b-b8f5c0b4da49" (UID: "50f84e90-e76b-4abe-a06b-b8f5c0b4da49"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:19:12.201426 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.201271    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-config" (OuterVolumeSpecName: "console-config") pod "50f84e90-e76b-4abe-a06b-b8f5c0b4da49" (UID: "50f84e90-e76b-4abe-a06b-b8f5c0b4da49"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:19:12.202913 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.202881    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "50f84e90-e76b-4abe-a06b-b8f5c0b4da49" (UID: "50f84e90-e76b-4abe-a06b-b8f5c0b4da49"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:19:12.202978 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.202945    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-kube-api-access-j4l2h" (OuterVolumeSpecName: "kube-api-access-j4l2h") pod "50f84e90-e76b-4abe-a06b-b8f5c0b4da49" (UID: "50f84e90-e76b-4abe-a06b-b8f5c0b4da49"). InnerVolumeSpecName "kube-api-access-j4l2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:19:12.203016 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.202978    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "50f84e90-e76b-4abe-a06b-b8f5c0b4da49" (UID: "50f84e90-e76b-4abe-a06b-b8f5c0b4da49"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:19:12.301263 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.301236    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-config\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:19:12.301263 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.301257    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4l2h\" (UniqueName: \"kubernetes.io/projected/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-kube-api-access-j4l2h\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:19:12.301263 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.301266    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:19:12.301479 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.301275    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-oauth-config\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:19:12.301479 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.301283    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-trusted-ca-bundle\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:19:12.301479 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.301290    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-oauth-serving-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:19:12.301479 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.301298    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50f84e90-e76b-4abe-a06b-b8f5c0b4da49-console-serving-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:19:12.916629 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.916595    2562 generic.go:356] "Generic (PLEG): container finished" podID="50f84e90-e76b-4abe-a06b-b8f5c0b4da49" containerID="c4285835ce246d6502d9af492c132f62dac1accc82d7f19c553288fbb92a73c3" exitCode=0
Sep 19 15:19:12.917087 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.916651    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69899b565c-ws9ww"
Sep 19 15:19:12.917087 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.916664    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69899b565c-ws9ww" event={"ID":"50f84e90-e76b-4abe-a06b-b8f5c0b4da49","Type":"ContainerDied","Data":"c4285835ce246d6502d9af492c132f62dac1accc82d7f19c553288fbb92a73c3"}
Sep 19 15:19:12.917087 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.916736    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69899b565c-ws9ww" event={"ID":"50f84e90-e76b-4abe-a06b-b8f5c0b4da49","Type":"ContainerDied","Data":"fce3ca8c2f27cf4acb998b09124a7913b30a579c488695904c638ecf0329b987"}
Sep 19 15:19:12.917087 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.916756    2562 scope.go:117] "RemoveContainer" containerID="c4285835ce246d6502d9af492c132f62dac1accc82d7f19c553288fbb92a73c3"
Sep 19 15:19:12.926389 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.926374    2562 scope.go:117] "RemoveContainer" containerID="c4285835ce246d6502d9af492c132f62dac1accc82d7f19c553288fbb92a73c3"
Sep 19 15:19:12.926664 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:19:12.926646    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4285835ce246d6502d9af492c132f62dac1accc82d7f19c553288fbb92a73c3\": container with ID starting with c4285835ce246d6502d9af492c132f62dac1accc82d7f19c553288fbb92a73c3 not found: ID does not exist" containerID="c4285835ce246d6502d9af492c132f62dac1accc82d7f19c553288fbb92a73c3"
Sep 19 15:19:12.926702 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.926673    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4285835ce246d6502d9af492c132f62dac1accc82d7f19c553288fbb92a73c3"} err="failed to get container status \"c4285835ce246d6502d9af492c132f62dac1accc82d7f19c553288fbb92a73c3\": rpc error: code = NotFound desc = could not find container \"c4285835ce246d6502d9af492c132f62dac1accc82d7f19c553288fbb92a73c3\": container with ID starting with c4285835ce246d6502d9af492c132f62dac1accc82d7f19c553288fbb92a73c3 not found: ID does not exist"
Sep 19 15:19:12.937488 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.937461    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69899b565c-ws9ww"]
Sep 19 15:19:12.943686 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:12.943651    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69899b565c-ws9ww"]
Sep 19 15:19:13.343832 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:13.343802    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50f84e90-e76b-4abe-a06b-b8f5c0b4da49" path="/var/lib/kubelet/pods/50f84e90-e76b-4abe-a06b-b8f5c0b4da49/volumes"
Sep 19 15:19:43.149990 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:43.149913    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:19:43.165602 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:43.165580    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:19:44.057341 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:44.057313    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 15:19:53.686456 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:53.686403    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:19:53.738706 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:19:53.738672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:20:05.659699 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:05.659660    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:20:05.713963 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:05.713938    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:20:11.451691 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:11.451654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:20:11.554064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:11.554015    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:20:11.652338 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:11.652308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:20:39.959508 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:39.959474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:20:40.052511 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:40.052477    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:20:40.996460 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:40.996426    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66f6b5b6bd-v4c5t"]
Sep 19 15:20:40.996858 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:40.996745    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50f84e90-e76b-4abe-a06b-b8f5c0b4da49" containerName="console"
Sep 19 15:20:40.996858 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:40.996756    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="50f84e90-e76b-4abe-a06b-b8f5c0b4da49" containerName="console"
Sep 19 15:20:40.996858 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:40.996822    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="50f84e90-e76b-4abe-a06b-b8f5c0b4da49" containerName="console"
Sep 19 15:20:40.999463 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:40.999444    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.008301 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.008277    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f6b5b6bd-v4c5t"]
Sep 19 15:20:41.063151 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.063124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqm25\" (UniqueName: \"kubernetes.io/projected/e21b840e-71bb-49d9-98a5-93238c688336-kube-api-access-bqm25\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.063302 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.063162    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e21b840e-71bb-49d9-98a5-93238c688336-console-serving-cert\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.063302 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.063182    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-trusted-ca-bundle\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.063302 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.063237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e21b840e-71bb-49d9-98a5-93238c688336-console-oauth-config\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.063302 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.063258    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-console-config\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.063302 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.063301    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-service-ca\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.063484 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.063343    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-oauth-serving-cert\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.085542 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.085513    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:20:41.164433 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.164403    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-oauth-serving-cert\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.164592 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.164444    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqm25\" (UniqueName: \"kubernetes.io/projected/e21b840e-71bb-49d9-98a5-93238c688336-kube-api-access-bqm25\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.164592 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.164465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e21b840e-71bb-49d9-98a5-93238c688336-console-serving-cert\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.164592 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.164484    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-trusted-ca-bundle\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.164592 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.164504    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e21b840e-71bb-49d9-98a5-93238c688336-console-oauth-config\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.164592 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.164529    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-console-config\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.164592 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.164560    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-service-ca\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.165296 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.165271    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-oauth-serving-cert\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.165642 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.165319    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-trusted-ca-bundle\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.165642 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.165350    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-service-ca\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.165758 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.165478    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-console-config\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.167137 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.167114    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e21b840e-71bb-49d9-98a5-93238c688336-console-oauth-config\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.167274 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.167258    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e21b840e-71bb-49d9-98a5-93238c688336-console-serving-cert\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.171547 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.171528    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqm25\" (UniqueName: \"kubernetes.io/projected/e21b840e-71bb-49d9-98a5-93238c688336-kube-api-access-bqm25\") pod \"console-66f6b5b6bd-v4c5t\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") " pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.310392 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.310365    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:41.582890 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:41.582760    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f6b5b6bd-v4c5t"]
Sep 19 15:20:41.585742 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:20:41.585713    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode21b840e_71bb_49d9_98a5_93238c688336.slice/crio-30c19dff891b00d1808e76759da83c45d00719c306e65a5679246574cfed6d64 WatchSource:0}: Error finding container 30c19dff891b00d1808e76759da83c45d00719c306e65a5679246574cfed6d64: Status 404 returned error can't find the container with id 30c19dff891b00d1808e76759da83c45d00719c306e65a5679246574cfed6d64
Sep 19 15:20:42.267498 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:42.267462    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f6b5b6bd-v4c5t" event={"ID":"e21b840e-71bb-49d9-98a5-93238c688336","Type":"ContainerStarted","Data":"5318eee11bfb9030120a0e19375eb5a33d1b6ba3fc1905d56396ff35e6a74f3d"}
Sep 19 15:20:42.267873 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:42.267518    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f6b5b6bd-v4c5t" event={"ID":"e21b840e-71bb-49d9-98a5-93238c688336","Type":"ContainerStarted","Data":"30c19dff891b00d1808e76759da83c45d00719c306e65a5679246574cfed6d64"}
Sep 19 15:20:42.284514 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:42.284471    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66f6b5b6bd-v4c5t" podStartSLOduration=2.284455139 podStartE2EDuration="2.284455139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:20:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:20:42.282979541 +0000 UTC m=+505.446394583" watchObservedRunningTime="2026-09-19 15:20:42.284455139 +0000 UTC m=+505.447870181"
Sep 19 15:20:51.311355 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:51.311323    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:51.311809 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:51.311378    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:51.316125 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:51.316094    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:52.314517 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:52.314488    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:20:52.354871 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:52.354841    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-744cc88f8-rq675"]
Sep 19 15:20:52.455866 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:52.455832    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:20:52.556211 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:52.556169    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:20:52.606375 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:20:52.606310    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:01.463372 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:01.463341    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:02.231115 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:02.231078    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:05.070381 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:05.070351    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:05.170264 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:05.170239    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:06.873830 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:06.873794    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:06.993372 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:06.993341    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:07.106150 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:07.106117    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:07.196978 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:07.196912    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:09.468246 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:09.468157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:09.681001 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:09.680961    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:12.070903 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:12.070862    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:12.123522 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:12.123489    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:16.673252 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:16.673218    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:17.374831 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.374802    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-744cc88f8-rq675" podUID="ebd03383-4772-4105-b5f7-44774737f6af" containerName="console" containerID="cri-o://ec19b65c310f9c18d33f3d6df218766fc371ebd1712381060c6f7552d1f53ba8" gracePeriod=15
Sep 19 15:21:17.614836 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.614814    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:21:17.752130 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.752049    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebd03383-4772-4105-b5f7-44774737f6af-console-serving-cert\") pod \"ebd03383-4772-4105-b5f7-44774737f6af\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") "
Sep 19 15:21:17.752130 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.752114    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-service-ca\") pod \"ebd03383-4772-4105-b5f7-44774737f6af\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") "
Sep 19 15:21:17.752613 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.752140    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-trusted-ca-bundle\") pod \"ebd03383-4772-4105-b5f7-44774737f6af\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") "
Sep 19 15:21:17.752613 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.752170    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhzcp\" (UniqueName: \"kubernetes.io/projected/ebd03383-4772-4105-b5f7-44774737f6af-kube-api-access-bhzcp\") pod \"ebd03383-4772-4105-b5f7-44774737f6af\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") "
Sep 19 15:21:17.752613 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.752215    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebd03383-4772-4105-b5f7-44774737f6af-console-oauth-config\") pod \"ebd03383-4772-4105-b5f7-44774737f6af\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") "
Sep 19 15:21:17.752613 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.752244    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-console-config\") pod \"ebd03383-4772-4105-b5f7-44774737f6af\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") "
Sep 19 15:21:17.752613 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.752305    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-oauth-serving-cert\") pod \"ebd03383-4772-4105-b5f7-44774737f6af\" (UID: \"ebd03383-4772-4105-b5f7-44774737f6af\") "
Sep 19 15:21:17.752613 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.752578    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-service-ca" (OuterVolumeSpecName: "service-ca") pod "ebd03383-4772-4105-b5f7-44774737f6af" (UID: "ebd03383-4772-4105-b5f7-44774737f6af"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:21:17.752923 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.752611    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ebd03383-4772-4105-b5f7-44774737f6af" (UID: "ebd03383-4772-4105-b5f7-44774737f6af"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:21:17.752923 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.752676    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-console-config" (OuterVolumeSpecName: "console-config") pod "ebd03383-4772-4105-b5f7-44774737f6af" (UID: "ebd03383-4772-4105-b5f7-44774737f6af"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:21:17.752923 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.752864    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ebd03383-4772-4105-b5f7-44774737f6af" (UID: "ebd03383-4772-4105-b5f7-44774737f6af"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:21:17.754437 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.754414    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebd03383-4772-4105-b5f7-44774737f6af-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ebd03383-4772-4105-b5f7-44774737f6af" (UID: "ebd03383-4772-4105-b5f7-44774737f6af"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:21:17.754530 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.754436    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebd03383-4772-4105-b5f7-44774737f6af-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ebd03383-4772-4105-b5f7-44774737f6af" (UID: "ebd03383-4772-4105-b5f7-44774737f6af"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:21:17.754530 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.754441    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebd03383-4772-4105-b5f7-44774737f6af-kube-api-access-bhzcp" (OuterVolumeSpecName: "kube-api-access-bhzcp") pod "ebd03383-4772-4105-b5f7-44774737f6af" (UID: "ebd03383-4772-4105-b5f7-44774737f6af"). InnerVolumeSpecName "kube-api-access-bhzcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:21:17.852815 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.852782    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebd03383-4772-4105-b5f7-44774737f6af-console-oauth-config\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:21:17.852815 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.852812    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-console-config\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:21:17.852815 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.852823    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-oauth-serving-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:21:17.852980 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.852831    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebd03383-4772-4105-b5f7-44774737f6af-console-serving-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:21:17.852980 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.852839    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:21:17.852980 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.852847    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebd03383-4772-4105-b5f7-44774737f6af-trusted-ca-bundle\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:21:17.852980 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:17.852857    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhzcp\" (UniqueName: \"kubernetes.io/projected/ebd03383-4772-4105-b5f7-44774737f6af-kube-api-access-bhzcp\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:21:18.408047 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:18.408009    2562 generic.go:356] "Generic (PLEG): container finished" podID="ebd03383-4772-4105-b5f7-44774737f6af" containerID="ec19b65c310f9c18d33f3d6df218766fc371ebd1712381060c6f7552d1f53ba8" exitCode=0
Sep 19 15:21:18.408231 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:18.408073    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744cc88f8-rq675"
Sep 19 15:21:18.408231 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:18.408095    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744cc88f8-rq675" event={"ID":"ebd03383-4772-4105-b5f7-44774737f6af","Type":"ContainerDied","Data":"ec19b65c310f9c18d33f3d6df218766fc371ebd1712381060c6f7552d1f53ba8"}
Sep 19 15:21:18.408231 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:18.408143    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744cc88f8-rq675" event={"ID":"ebd03383-4772-4105-b5f7-44774737f6af","Type":"ContainerDied","Data":"5c95a1d67a6accd475f00170426e67df055cfd87cfe6ef733a63b77cd698588f"}
Sep 19 15:21:18.408231 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:18.408162    2562 scope.go:117] "RemoveContainer" containerID="ec19b65c310f9c18d33f3d6df218766fc371ebd1712381060c6f7552d1f53ba8"
Sep 19 15:21:18.416950 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:18.416933    2562 scope.go:117] "RemoveContainer" containerID="ec19b65c310f9c18d33f3d6df218766fc371ebd1712381060c6f7552d1f53ba8"
Sep 19 15:21:18.417252 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:21:18.417235    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec19b65c310f9c18d33f3d6df218766fc371ebd1712381060c6f7552d1f53ba8\": container with ID starting with ec19b65c310f9c18d33f3d6df218766fc371ebd1712381060c6f7552d1f53ba8 not found: ID does not exist" containerID="ec19b65c310f9c18d33f3d6df218766fc371ebd1712381060c6f7552d1f53ba8"
Sep 19 15:21:18.417309 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:18.417260    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec19b65c310f9c18d33f3d6df218766fc371ebd1712381060c6f7552d1f53ba8"} err="failed to get container status \"ec19b65c310f9c18d33f3d6df218766fc371ebd1712381060c6f7552d1f53ba8\": rpc error: code = NotFound desc = could not find container \"ec19b65c310f9c18d33f3d6df218766fc371ebd1712381060c6f7552d1f53ba8\": container with ID starting with ec19b65c310f9c18d33f3d6df218766fc371ebd1712381060c6f7552d1f53ba8 not found: ID does not exist"
Sep 19 15:21:18.426714 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:18.426690    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-744cc88f8-rq675"]
Sep 19 15:21:18.428503 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:18.428486    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-744cc88f8-rq675"]
Sep 19 15:21:19.343007 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:19.342975    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebd03383-4772-4105-b5f7-44774737f6af" path="/var/lib/kubelet/pods/ebd03383-4772-4105-b5f7-44774737f6af/volumes"
Sep 19 15:21:19.545235 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:19.545181    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:19.648392 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:19.648328    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:22.707124 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:22.707093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:25.643950 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:25.643918    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:25.748153 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:25.748124    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:27.815760 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:27.815732    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:42.423125 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:42.423074    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:42.524044 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:42.524014    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:43.299810 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:43.299780    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:43.395827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:43.395799    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:43.914701 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:43.914673    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:44.079346 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.079317    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:44.178812 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.178738    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:44.218449 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.218419    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"]
Sep 19 15:21:44.218719 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.218707    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd03383-4772-4105-b5f7-44774737f6af" containerName="console"
Sep 19 15:21:44.218774 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.218721    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd03383-4772-4105-b5f7-44774737f6af" containerName="console"
Sep 19 15:21:44.218814 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.218785    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebd03383-4772-4105-b5f7-44774737f6af" containerName="console"
Sep 19 15:21:44.221787 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.221761    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:44.224034 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.224011    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 19 15:21:44.224166 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.224064    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 19 15:21:44.224256 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.224235    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 19 15:21:44.224316 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.224273    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 19 15:21:44.224546 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.224508    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6pmc7\""
Sep 19 15:21:44.238018 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.237996    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"]
Sep 19 15:21:44.261879 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.261860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0d18380-844e-411f-b680-61005fce5889-webhook-cert\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-9clj9\" (UID: \"c0d18380-844e-411f-b680-61005fce5889\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:44.261985 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.261887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0d18380-844e-411f-b680-61005fce5889-tmp\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-9clj9\" (UID: \"c0d18380-844e-411f-b680-61005fce5889\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:44.261985 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.261906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kgfg\" (UniqueName: \"kubernetes.io/projected/c0d18380-844e-411f-b680-61005fce5889-kube-api-access-9kgfg\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-9clj9\" (UID: \"c0d18380-844e-411f-b680-61005fce5889\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:44.261985 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.261936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c0d18380-844e-411f-b680-61005fce5889-manifests\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-9clj9\" (UID: \"c0d18380-844e-411f-b680-61005fce5889\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:44.261985 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.261968    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c0d18380-844e-411f-b680-61005fce5889-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-9clj9\" (UID: \"c0d18380-844e-411f-b680-61005fce5889\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:44.345870 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.345844    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:44.362903 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.362876    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0d18380-844e-411f-b680-61005fce5889-webhook-cert\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-9clj9\" (UID: \"c0d18380-844e-411f-b680-61005fce5889\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:44.363009 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.362908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0d18380-844e-411f-b680-61005fce5889-tmp\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-9clj9\" (UID: \"c0d18380-844e-411f-b680-61005fce5889\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:44.363009 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.362934    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kgfg\" (UniqueName: \"kubernetes.io/projected/c0d18380-844e-411f-b680-61005fce5889-kube-api-access-9kgfg\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-9clj9\" (UID: \"c0d18380-844e-411f-b680-61005fce5889\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:44.363009 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.362976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c0d18380-844e-411f-b680-61005fce5889-manifests\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-9clj9\" (UID: \"c0d18380-844e-411f-b680-61005fce5889\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:44.363009 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.363003    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c0d18380-844e-411f-b680-61005fce5889-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-9clj9\" (UID: \"c0d18380-844e-411f-b680-61005fce5889\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:44.363395 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.363369    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c0d18380-844e-411f-b680-61005fce5889-manifests\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-9clj9\" (UID: \"c0d18380-844e-411f-b680-61005fce5889\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:44.365293 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.365268    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0d18380-844e-411f-b680-61005fce5889-tmp\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-9clj9\" (UID: \"c0d18380-844e-411f-b680-61005fce5889\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:44.365452 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.365435    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c0d18380-844e-411f-b680-61005fce5889-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-9clj9\" (UID: \"c0d18380-844e-411f-b680-61005fce5889\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:44.365513 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.365452    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0d18380-844e-411f-b680-61005fce5889-webhook-cert\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-9clj9\" (UID: \"c0d18380-844e-411f-b680-61005fce5889\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:44.370010 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.369994    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kgfg\" (UniqueName: \"kubernetes.io/projected/c0d18380-844e-411f-b680-61005fce5889-kube-api-access-9kgfg\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-9clj9\" (UID: \"c0d18380-844e-411f-b680-61005fce5889\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:44.436492 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.436431    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:44.532016 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.531988    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:44.536413 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.536390    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:44.636863 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.636828    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:44.715822 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.715741    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:44.810370 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:44.810340    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"]
Sep 19 15:21:44.813015 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:21:44.812988    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d18380_844e_411f_b680_61005fce5889.slice/crio-ce9cb64463c20cec0b26c3162ab5831ff248bd87f0dcb18110c2086d2ae7a542 WatchSource:0}: Error finding container ce9cb64463c20cec0b26c3162ab5831ff248bd87f0dcb18110c2086d2ae7a542: Status 404 returned error can't find the container with id ce9cb64463c20cec0b26c3162ab5831ff248bd87f0dcb18110c2086d2ae7a542
Sep 19 15:21:45.521660 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:45.521627    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9" event={"ID":"c0d18380-844e-411f-b680-61005fce5889","Type":"ContainerStarted","Data":"ce9cb64463c20cec0b26c3162ab5831ff248bd87f0dcb18110c2086d2ae7a542"}
Sep 19 15:21:48.536369 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:48.536334    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9" event={"ID":"c0d18380-844e-411f-b680-61005fce5889","Type":"ContainerStarted","Data":"3535ad53377575373a090fa3d283acdcd16e76a2ba1e3a6bf893207c4d4975ec"}
Sep 19 15:21:49.542244 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:49.542185    2562 generic.go:356] "Generic (PLEG): container finished" podID="c0d18380-844e-411f-b680-61005fce5889" containerID="3535ad53377575373a090fa3d283acdcd16e76a2ba1e3a6bf893207c4d4975ec" exitCode=0
Sep 19 15:21:49.542667 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:49.542247    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9" event={"ID":"c0d18380-844e-411f-b680-61005fce5889","Type":"ContainerDied","Data":"3535ad53377575373a090fa3d283acdcd16e76a2ba1e3a6bf893207c4d4975ec"}
Sep 19 15:21:50.549570 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:50.549531    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9" event={"ID":"c0d18380-844e-411f-b680-61005fce5889","Type":"ContainerStarted","Data":"5c4b0388954e18d48d9786bd41a3fb20d9d367ffaf05df428c55c35671031e42"}
Sep 19 15:21:50.549966 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:50.549659    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:21:50.570930 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:50.570886    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9" podStartSLOduration=2.207001784 podStartE2EDuration="6.570871407s" totalImagesPullingTime="3.285643432s" totalInitContainerRuntime="1.078226191s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:21:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:21:50.569624964 +0000 UTC m=+573.733040004" watchObservedRunningTime="2026-09-19 15:21:50.570871407 +0000 UTC m=+573.734286448"
Sep 19 15:21:56.359102 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:56.359066    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:56.459154 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:56.459120    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:57.754227 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.754174    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69dc668f4d-hbwxl"]
Sep 19 15:21:57.765744 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.765713    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.766845 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.766816    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69dc668f4d-hbwxl"]
Sep 19 15:21:57.809579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.809543    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:21:57.872476 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.872453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09d3a394-7a69-47ff-966a-a0d1018c171f-console-oauth-config\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.872558 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.872481    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84qgp\" (UniqueName: \"kubernetes.io/projected/09d3a394-7a69-47ff-966a-a0d1018c171f-kube-api-access-84qgp\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.872558 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.872504    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09d3a394-7a69-47ff-966a-a0d1018c171f-trusted-ca-bundle\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.872648 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.872571    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09d3a394-7a69-47ff-966a-a0d1018c171f-service-ca\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.872648 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.872606    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09d3a394-7a69-47ff-966a-a0d1018c171f-oauth-serving-cert\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.872648 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.872626    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09d3a394-7a69-47ff-966a-a0d1018c171f-console-config\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.872761 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.872647    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09d3a394-7a69-47ff-966a-a0d1018c171f-console-serving-cert\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.973710 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.973685    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09d3a394-7a69-47ff-966a-a0d1018c171f-service-ca\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.973827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.973722    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09d3a394-7a69-47ff-966a-a0d1018c171f-oauth-serving-cert\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.973827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.973741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09d3a394-7a69-47ff-966a-a0d1018c171f-console-config\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.973827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.973763    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09d3a394-7a69-47ff-966a-a0d1018c171f-console-serving-cert\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.973827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.973804    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09d3a394-7a69-47ff-966a-a0d1018c171f-console-oauth-config\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.973827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.973824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84qgp\" (UniqueName: \"kubernetes.io/projected/09d3a394-7a69-47ff-966a-a0d1018c171f-kube-api-access-84qgp\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.974061 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.973845    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09d3a394-7a69-47ff-966a-a0d1018c171f-trusted-ca-bundle\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.974503 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.974477    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09d3a394-7a69-47ff-966a-a0d1018c171f-service-ca\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.974602 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.974530    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09d3a394-7a69-47ff-966a-a0d1018c171f-console-config\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.974655 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.974627    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09d3a394-7a69-47ff-966a-a0d1018c171f-oauth-serving-cert\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.975000 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.974975    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09d3a394-7a69-47ff-966a-a0d1018c171f-trusted-ca-bundle\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.976340 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.976316    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09d3a394-7a69-47ff-966a-a0d1018c171f-console-oauth-config\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.976467 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.976450    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09d3a394-7a69-47ff-966a-a0d1018c171f-console-serving-cert\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:57.980692 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:57.980669    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84qgp\" (UniqueName: \"kubernetes.io/projected/09d3a394-7a69-47ff-966a-a0d1018c171f-kube-api-access-84qgp\") pod \"console-69dc668f4d-hbwxl\" (UID: \"09d3a394-7a69-47ff-966a-a0d1018c171f\") " pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:58.075318 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:58.075287    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:21:58.344878 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:58.344858    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69dc668f4d-hbwxl"]
Sep 19 15:21:58.347530 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:21:58.347499    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d3a394_7a69_47ff_966a_a0d1018c171f.slice/crio-3249f4449111da2542eca71e4dc35bab9eccfe8e281f993d3a2eeea54e742dc7 WatchSource:0}: Error finding container 3249f4449111da2542eca71e4dc35bab9eccfe8e281f993d3a2eeea54e742dc7: Status 404 returned error can't find the container with id 3249f4449111da2542eca71e4dc35bab9eccfe8e281f993d3a2eeea54e742dc7
Sep 19 15:21:58.592318 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:58.592287    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69dc668f4d-hbwxl" event={"ID":"09d3a394-7a69-47ff-966a-a0d1018c171f","Type":"ContainerStarted","Data":"e4f5c4321bb57e870d4aef17f42476b6d311ffde2cacaa1463fdfebff10bfe2c"}
Sep 19 15:21:58.592482 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:58.592370    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69dc668f4d-hbwxl" event={"ID":"09d3a394-7a69-47ff-966a-a0d1018c171f","Type":"ContainerStarted","Data":"3249f4449111da2542eca71e4dc35bab9eccfe8e281f993d3a2eeea54e742dc7"}
Sep 19 15:21:58.610659 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:21:58.610576    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69dc668f4d-hbwxl" podStartSLOduration=1.610562796 podStartE2EDuration="1.610562796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:21:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:21:58.609453425 +0000 UTC m=+581.772868466" watchObservedRunningTime="2026-09-19 15:21:58.610562796 +0000 UTC m=+581.773977836"
Sep 19 15:22:01.556236 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:01.556206    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-9clj9"
Sep 19 15:22:04.337392 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:04.337359    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:04.440223 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:04.440176    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:04.646802 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:04.646729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:04.874673 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:04.874643    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:05.965644 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:05.965611    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:06.064272 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:06.064242    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:06.914954 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:06.914913    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:08.075520 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:08.075487    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:22:08.075906 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:08.075538    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:22:08.080532 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:08.080506    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:22:08.637936 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:08.637908    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69dc668f4d-hbwxl"
Sep 19 15:22:08.679528 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:08.679502    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66f6b5b6bd-v4c5t"]
Sep 19 15:22:08.775414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:08.775386    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:08.881373 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:08.881336    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:08.982190 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:08.982118    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:10.820010 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:10.819975    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:11.075135 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.075062    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"]
Sep 19 15:22:11.078365 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.078350    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.080650 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.080628    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 19 15:22:11.080650 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.080632    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 19 15:22:11.080858 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.080632    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-z78wr\""
Sep 19 15:22:11.080858 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.080679    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 19 15:22:11.088828 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.088790    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"]
Sep 19 15:22:11.188738 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.188712    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.188855 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.188756    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.188855 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.188774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjmn8\" (UniqueName: \"kubernetes.io/projected/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-kube-api-access-hjmn8\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.188855 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.188794    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.188962 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.188867    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.188962 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.188901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.188962 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.188918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.188962 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.188932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.189081 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.188992    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.290055 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.290024    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.290190 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.290058    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.290190 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.290083    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.290190 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.290112    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.290190 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.290171    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.290440 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.290250    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.290440 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.290279    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjmn8\" (UniqueName: \"kubernetes.io/projected/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-kube-api-access-hjmn8\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.290440 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.290313    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.290440 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.290367    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.290637 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.290484    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.290637 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.290624    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.290804 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.290758    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.290865 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.290845    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.291035 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.291015    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.293321 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.293297    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.293479 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.293463    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.297738 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.297711    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjmn8\" (UniqueName: \"kubernetes.io/projected/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-kube-api-access-hjmn8\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.297831 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.297722    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f011b6f-baee-43f6-97a7-fe3dd585a9b3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs\" (UID: \"8f011b6f-baee-43f6-97a7-fe3dd585a9b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.389652 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.389600    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:11.661048 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.661027    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"]
Sep 19 15:22:11.663397 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:22:11.663370    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f011b6f_baee_43f6_97a7_fe3dd585a9b3.slice/crio-d44ed2c34617f243959a9d391b5bf2c8bde9cbd56f8b4c5ab0c83a421153b74f WatchSource:0}: Error finding container d44ed2c34617f243959a9d391b5bf2c8bde9cbd56f8b4c5ab0c83a421153b74f: Status 404 returned error can't find the container with id d44ed2c34617f243959a9d391b5bf2c8bde9cbd56f8b4c5ab0c83a421153b74f
Sep 19 15:22:11.858517 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:11.858490    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:12.653324 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:12.653283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs" event={"ID":"8f011b6f-baee-43f6-97a7-fe3dd585a9b3","Type":"ContainerStarted","Data":"d44ed2c34617f243959a9d391b5bf2c8bde9cbd56f8b4c5ab0c83a421153b74f"}
Sep 19 15:22:12.855003 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:12.854973    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"]
Sep 19 15:22:12.858393 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:12.858370    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"
Sep 19 15:22:12.861827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:12.861804    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 19 15:22:12.862134 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:12.861837    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 19 15:22:12.862134 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:12.861847    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 19 15:22:12.862134 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:12.861859    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2fcld\""
Sep 19 15:22:12.862134 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:12.861872    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 19 15:22:12.862134 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:12.861885    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 19 15:22:12.866113 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:12.866085    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"]
Sep 19 15:22:13.002787 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:13.002691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8cc57920-0038-420f-9adb-dbc73f535e7a-manager-config\") pod \"lws-controller-manager-7b79856b6-vd6hb\" (UID: \"8cc57920-0038-420f-9adb-dbc73f535e7a\") " pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"
Sep 19 15:22:13.002787 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:13.002758    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdt65\" (UniqueName: \"kubernetes.io/projected/8cc57920-0038-420f-9adb-dbc73f535e7a-kube-api-access-xdt65\") pod \"lws-controller-manager-7b79856b6-vd6hb\" (UID: \"8cc57920-0038-420f-9adb-dbc73f535e7a\") " pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"
Sep 19 15:22:13.002982 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:13.002865    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cc57920-0038-420f-9adb-dbc73f535e7a-cert\") pod \"lws-controller-manager-7b79856b6-vd6hb\" (UID: \"8cc57920-0038-420f-9adb-dbc73f535e7a\") " pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"
Sep 19 15:22:13.002982 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:13.002882    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cc57920-0038-420f-9adb-dbc73f535e7a-metrics-cert\") pod \"lws-controller-manager-7b79856b6-vd6hb\" (UID: \"8cc57920-0038-420f-9adb-dbc73f535e7a\") " pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"
Sep 19 15:22:13.104033 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:13.103993    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cc57920-0038-420f-9adb-dbc73f535e7a-cert\") pod \"lws-controller-manager-7b79856b6-vd6hb\" (UID: \"8cc57920-0038-420f-9adb-dbc73f535e7a\") " pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"
Sep 19 15:22:13.104033 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:13.104033    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cc57920-0038-420f-9adb-dbc73f535e7a-metrics-cert\") pod \"lws-controller-manager-7b79856b6-vd6hb\" (UID: \"8cc57920-0038-420f-9adb-dbc73f535e7a\") " pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"
Sep 19 15:22:13.104299 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:13.104057    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8cc57920-0038-420f-9adb-dbc73f535e7a-manager-config\") pod \"lws-controller-manager-7b79856b6-vd6hb\" (UID: \"8cc57920-0038-420f-9adb-dbc73f535e7a\") " pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"
Sep 19 15:22:13.104299 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:13.104109    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdt65\" (UniqueName: \"kubernetes.io/projected/8cc57920-0038-420f-9adb-dbc73f535e7a-kube-api-access-xdt65\") pod \"lws-controller-manager-7b79856b6-vd6hb\" (UID: \"8cc57920-0038-420f-9adb-dbc73f535e7a\") " pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"
Sep 19 15:22:13.105214 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:13.105157    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8cc57920-0038-420f-9adb-dbc73f535e7a-manager-config\") pod \"lws-controller-manager-7b79856b6-vd6hb\" (UID: \"8cc57920-0038-420f-9adb-dbc73f535e7a\") " pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"
Sep 19 15:22:13.107109 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:13.107079    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cc57920-0038-420f-9adb-dbc73f535e7a-metrics-cert\") pod \"lws-controller-manager-7b79856b6-vd6hb\" (UID: \"8cc57920-0038-420f-9adb-dbc73f535e7a\") " pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"
Sep 19 15:22:13.107222 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:13.107133    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cc57920-0038-420f-9adb-dbc73f535e7a-cert\") pod \"lws-controller-manager-7b79856b6-vd6hb\" (UID: \"8cc57920-0038-420f-9adb-dbc73f535e7a\") " pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"
Sep 19 15:22:13.112119 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:13.112098    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdt65\" (UniqueName: \"kubernetes.io/projected/8cc57920-0038-420f-9adb-dbc73f535e7a-kube-api-access-xdt65\") pod \"lws-controller-manager-7b79856b6-vd6hb\" (UID: \"8cc57920-0038-420f-9adb-dbc73f535e7a\") " pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"
Sep 19 15:22:13.174580 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:13.174542    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"
Sep 19 15:22:13.452319 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:13.452295    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"]
Sep 19 15:22:13.454425 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:22:13.454397    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cc57920_0038_420f_9adb_dbc73f535e7a.slice/crio-d49b247df58ef7b6492c940d444a534a9e117075891526f1e5cc2f56c47228a3 WatchSource:0}: Error finding container d49b247df58ef7b6492c940d444a534a9e117075891526f1e5cc2f56c47228a3: Status 404 returned error can't find the container with id d49b247df58ef7b6492c940d444a534a9e117075891526f1e5cc2f56c47228a3
Sep 19 15:22:13.659179 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:13.659144    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb" event={"ID":"8cc57920-0038-420f-9adb-dbc73f535e7a","Type":"ContainerStarted","Data":"d49b247df58ef7b6492c940d444a534a9e117075891526f1e5cc2f56c47228a3"}
Sep 19 15:22:15.527161 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:15.527131    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hht6k"]
Sep 19 15:22:15.532547 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:15.532523    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hht6k"
Sep 19 15:22:15.535586 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:15.535545    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 19 15:22:15.535586 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:15.535546    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zt924\""
Sep 19 15:22:15.538938 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:15.538915    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hht6k"]
Sep 19 15:22:15.593424 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:15.593378    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:15.627495 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:15.627469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1dff80a-36ed-4a22-b6f4-38191af17d33-cert\") pod \"odh-model-controller-7998c67dc4-hht6k\" (UID: \"b1dff80a-36ed-4a22-b6f4-38191af17d33\") " pod="opendatahub/odh-model-controller-7998c67dc4-hht6k"
Sep 19 15:22:15.627664 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:15.627550    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5srmd\" (UniqueName: \"kubernetes.io/projected/b1dff80a-36ed-4a22-b6f4-38191af17d33-kube-api-access-5srmd\") pod \"odh-model-controller-7998c67dc4-hht6k\" (UID: \"b1dff80a-36ed-4a22-b6f4-38191af17d33\") " pod="opendatahub/odh-model-controller-7998c67dc4-hht6k"
Sep 19 15:22:15.696649 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:15.696606    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:15.728953 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:15.728922    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1dff80a-36ed-4a22-b6f4-38191af17d33-cert\") pod \"odh-model-controller-7998c67dc4-hht6k\" (UID: \"b1dff80a-36ed-4a22-b6f4-38191af17d33\") " pod="opendatahub/odh-model-controller-7998c67dc4-hht6k"
Sep 19 15:22:15.729244 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:15.729002    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5srmd\" (UniqueName: \"kubernetes.io/projected/b1dff80a-36ed-4a22-b6f4-38191af17d33-kube-api-access-5srmd\") pod \"odh-model-controller-7998c67dc4-hht6k\" (UID: \"b1dff80a-36ed-4a22-b6f4-38191af17d33\") " pod="opendatahub/odh-model-controller-7998c67dc4-hht6k"
Sep 19 15:22:15.729244 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:22:15.729112    2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 19 15:22:15.729244 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:22:15.729207    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1dff80a-36ed-4a22-b6f4-38191af17d33-cert podName:b1dff80a-36ed-4a22-b6f4-38191af17d33 nodeName:}" failed. No retries permitted until 2026-09-19 15:22:16.229170364 +0000 UTC m=+599.392585392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1dff80a-36ed-4a22-b6f4-38191af17d33-cert") pod "odh-model-controller-7998c67dc4-hht6k" (UID: "b1dff80a-36ed-4a22-b6f4-38191af17d33") : secret "odh-model-controller-webhook-cert" not found
Sep 19 15:22:15.738051 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:15.738024    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5srmd\" (UniqueName: \"kubernetes.io/projected/b1dff80a-36ed-4a22-b6f4-38191af17d33-kube-api-access-5srmd\") pod \"odh-model-controller-7998c67dc4-hht6k\" (UID: \"b1dff80a-36ed-4a22-b6f4-38191af17d33\") " pod="opendatahub/odh-model-controller-7998c67dc4-hht6k"
Sep 19 15:22:15.793852 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:15.793824    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:16.046483 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.046382    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:16.099594 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.099566    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6h2sw"]
Sep 19 15:22:16.106450 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.106420    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6h2sw"
Sep 19 15:22:16.108989 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.108959    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-lcxx5\""
Sep 19 15:22:16.109083 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.108969    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 19 15:22:16.113051 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.113028    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6h2sw"]
Sep 19 15:22:16.116814 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.116448    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:16.164024 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.163978    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:16.233688 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.233660    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1dff80a-36ed-4a22-b6f4-38191af17d33-cert\") pod \"odh-model-controller-7998c67dc4-hht6k\" (UID: \"b1dff80a-36ed-4a22-b6f4-38191af17d33\") " pod="opendatahub/odh-model-controller-7998c67dc4-hht6k"
Sep 19 15:22:16.233819 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.233712    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246a63da-6788-4466-837b-d2e77bcbb139-tls-certs\") pod \"model-serving-api-54d89bd5fc-6h2sw\" (UID: \"246a63da-6788-4466-837b-d2e77bcbb139\") " pod="opendatahub/model-serving-api-54d89bd5fc-6h2sw"
Sep 19 15:22:16.233819 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.233760    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nlw6\" (UniqueName: \"kubernetes.io/projected/246a63da-6788-4466-837b-d2e77bcbb139-kube-api-access-5nlw6\") pod \"model-serving-api-54d89bd5fc-6h2sw\" (UID: \"246a63da-6788-4466-837b-d2e77bcbb139\") " pod="opendatahub/model-serving-api-54d89bd5fc-6h2sw"
Sep 19 15:22:16.236408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.236384    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1dff80a-36ed-4a22-b6f4-38191af17d33-cert\") pod \"odh-model-controller-7998c67dc4-hht6k\" (UID: \"b1dff80a-36ed-4a22-b6f4-38191af17d33\") " pod="opendatahub/odh-model-controller-7998c67dc4-hht6k"
Sep 19 15:22:16.335239 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.335156    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246a63da-6788-4466-837b-d2e77bcbb139-tls-certs\") pod \"model-serving-api-54d89bd5fc-6h2sw\" (UID: \"246a63da-6788-4466-837b-d2e77bcbb139\") " pod="opendatahub/model-serving-api-54d89bd5fc-6h2sw"
Sep 19 15:22:16.335239 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.335233    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nlw6\" (UniqueName: \"kubernetes.io/projected/246a63da-6788-4466-837b-d2e77bcbb139-kube-api-access-5nlw6\") pod \"model-serving-api-54d89bd5fc-6h2sw\" (UID: \"246a63da-6788-4466-837b-d2e77bcbb139\") " pod="opendatahub/model-serving-api-54d89bd5fc-6h2sw"
Sep 19 15:22:16.337862 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.337841    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246a63da-6788-4466-837b-d2e77bcbb139-tls-certs\") pod \"model-serving-api-54d89bd5fc-6h2sw\" (UID: \"246a63da-6788-4466-837b-d2e77bcbb139\") " pod="opendatahub/model-serving-api-54d89bd5fc-6h2sw"
Sep 19 15:22:16.343169 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.343144    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nlw6\" (UniqueName: \"kubernetes.io/projected/246a63da-6788-4466-837b-d2e77bcbb139-kube-api-access-5nlw6\") pod \"model-serving-api-54d89bd5fc-6h2sw\" (UID: \"246a63da-6788-4466-837b-d2e77bcbb139\") " pod="opendatahub/model-serving-api-54d89bd5fc-6h2sw"
Sep 19 15:22:16.420279 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.420248    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6h2sw"
Sep 19 15:22:16.447278 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.447259    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hht6k"
Sep 19 15:22:16.929294 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.929244    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:22:16.929613 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.929348    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:22:16.929613 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:16.929394    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:22:17.204015 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:17.203686    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hht6k"]
Sep 19 15:22:17.206628 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:17.206605    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6h2sw"]
Sep 19 15:22:17.483549 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:22:17.483455    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod246a63da_6788_4466_837b_d2e77bcbb139.slice/crio-6483f0e8197659382f892001ef5fd112a154aafc11481ca571cdaf2512c1487e WatchSource:0}: Error finding container 6483f0e8197659382f892001ef5fd112a154aafc11481ca571cdaf2512c1487e: Status 404 returned error can't find the container with id 6483f0e8197659382f892001ef5fd112a154aafc11481ca571cdaf2512c1487e
Sep 19 15:22:17.484288 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:22:17.484259    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1dff80a_36ed_4a22_b6f4_38191af17d33.slice/crio-d5803826a363afb989dde42540700b9bb232ec5dce0b7614bdd25bad07ff4221 WatchSource:0}: Error finding container d5803826a363afb989dde42540700b9bb232ec5dce0b7614bdd25bad07ff4221: Status 404 returned error can't find the container with id d5803826a363afb989dde42540700b9bb232ec5dce0b7614bdd25bad07ff4221
Sep 19 15:22:17.680487 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:17.680448    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs" event={"ID":"8f011b6f-baee-43f6-97a7-fe3dd585a9b3","Type":"ContainerStarted","Data":"22fab3e92114c7ae3360acae21a6b6da7ef11222ee91653ed5bb20f07f51e731"}
Sep 19 15:22:17.682148 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:17.682119    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb" event={"ID":"8cc57920-0038-420f-9adb-dbc73f535e7a","Type":"ContainerStarted","Data":"a5cf887327eb56e0e56543cb09eb35e1d2af7a87efb8d7defd37b2d472b097f2"}
Sep 19 15:22:17.682292 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:17.682220    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"
Sep 19 15:22:17.683504 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:17.683478    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hht6k" event={"ID":"b1dff80a-36ed-4a22-b6f4-38191af17d33","Type":"ContainerStarted","Data":"d5803826a363afb989dde42540700b9bb232ec5dce0b7614bdd25bad07ff4221"}
Sep 19 15:22:17.684706 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:17.684668    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6h2sw" event={"ID":"246a63da-6788-4466-837b-d2e77bcbb139","Type":"ContainerStarted","Data":"6483f0e8197659382f892001ef5fd112a154aafc11481ca571cdaf2512c1487e"}
Sep 19 15:22:17.698581 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:17.698530    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs" podStartSLOduration=1.434711225 podStartE2EDuration="6.698512754s" totalImagesPullingTime="5.263801529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:22:17.69759305 +0000 UTC m=+600.861008094" watchObservedRunningTime="2026-09-19 15:22:17.698512754 +0000 UTC m=+600.861927795"
Sep 19 15:22:17.714240 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:17.714177    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb" podStartSLOduration=1.622853735 podStartE2EDuration="5.714161876s" totalImagesPullingTime="4.091308141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:22:17.714138489 +0000 UTC m=+600.877553530" watchObservedRunningTime="2026-09-19 15:22:17.714161876 +0000 UTC m=+600.877576913"
Sep 19 15:22:18.390402 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:18.390364    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:18.396849 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:18.396821    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:18.691995 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:18.691920    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:18.693167 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:18.693143    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs"
Sep 19 15:22:21.708252 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:21.708131    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hht6k" event={"ID":"b1dff80a-36ed-4a22-b6f4-38191af17d33","Type":"ContainerStarted","Data":"7936f475e4d657d7cb40a9f5e54b0def0739fbcd6ea3c96174d2c497f36b0cb3"}
Sep 19 15:22:21.708714 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:21.708254    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-hht6k"
Sep 19 15:22:21.709920 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:21.709899    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6h2sw" event={"ID":"246a63da-6788-4466-837b-d2e77bcbb139","Type":"ContainerStarted","Data":"80bdee32192d1b727bb419edbe3b0da7ca69de0e94e0f5235e6059d04a01da01"}
Sep 19 15:22:21.710047 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:21.710019    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-6h2sw"
Sep 19 15:22:21.726320 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:21.726281    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-hht6k" podStartSLOduration=2.861205749 podStartE2EDuration="6.72626798s" totalImagesPullingTime="3.865062231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:22:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:22:21.724625918 +0000 UTC m=+604.888040971" watchObservedRunningTime="2026-09-19 15:22:21.72626798 +0000 UTC m=+604.889683019"
Sep 19 15:22:21.742343 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:21.742301    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-6h2sw" podStartSLOduration=1.9240055090000001 podStartE2EDuration="5.742287538s" totalImagesPullingTime="3.818282029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:22:21.741190789 +0000 UTC m=+604.904605834" watchObservedRunningTime="2026-09-19 15:22:21.742287538 +0000 UTC m=+604.905702578"
Sep 19 15:22:24.341275 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:24.341245    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:24.451104 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:24.451070    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hssgm"]
Sep 19 15:22:24.454605 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:24.454586    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hssgm"
Sep 19 15:22:24.459675 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:24.459647    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 19 15:22:24.460137 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:24.460118    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-n2h75\""
Sep 19 15:22:24.480067 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:24.480024    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hssgm"]
Sep 19 15:22:24.486860 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:24.486835    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:24.512291 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:24.512265    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81afd963-013e-4e1c-b01e-fa8bfb068544-cert\") pod \"kserve-controller-manager-d6f4b65b8-hssgm\" (UID: \"81afd963-013e-4e1c-b01e-fa8bfb068544\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hssgm"
Sep 19 15:22:24.512401 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:24.512343    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdbl6\" (UniqueName: \"kubernetes.io/projected/81afd963-013e-4e1c-b01e-fa8bfb068544-kube-api-access-sdbl6\") pod \"kserve-controller-manager-d6f4b65b8-hssgm\" (UID: \"81afd963-013e-4e1c-b01e-fa8bfb068544\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hssgm"
Sep 19 15:22:24.613515 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:24.613441    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81afd963-013e-4e1c-b01e-fa8bfb068544-cert\") pod \"kserve-controller-manager-d6f4b65b8-hssgm\" (UID: \"81afd963-013e-4e1c-b01e-fa8bfb068544\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hssgm"
Sep 19 15:22:24.613628 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:24.613562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdbl6\" (UniqueName: \"kubernetes.io/projected/81afd963-013e-4e1c-b01e-fa8bfb068544-kube-api-access-sdbl6\") pod \"kserve-controller-manager-d6f4b65b8-hssgm\" (UID: \"81afd963-013e-4e1c-b01e-fa8bfb068544\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hssgm"
Sep 19 15:22:24.615984 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:24.615964    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81afd963-013e-4e1c-b01e-fa8bfb068544-cert\") pod \"kserve-controller-manager-d6f4b65b8-hssgm\" (UID: \"81afd963-013e-4e1c-b01e-fa8bfb068544\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hssgm"
Sep 19 15:22:24.621953 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:24.621931    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdbl6\" (UniqueName: \"kubernetes.io/projected/81afd963-013e-4e1c-b01e-fa8bfb068544-kube-api-access-sdbl6\") pod \"kserve-controller-manager-d6f4b65b8-hssgm\" (UID: \"81afd963-013e-4e1c-b01e-fa8bfb068544\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hssgm"
Sep 19 15:22:24.638313 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:24.638277    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:24.745760 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:24.745738    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:24.764354 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:24.764333    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hssgm"
Sep 19 15:22:25.036858 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:25.036835    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hssgm"]
Sep 19 15:22:25.038729 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:22:25.038706    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81afd963_013e_4e1c_b01e_fa8bfb068544.slice/crio-eaa35047055d1f045350930d28cca8379cdd4fb4b2cd66e764d6ad9f69d6a747 WatchSource:0}: Error finding container eaa35047055d1f045350930d28cca8379cdd4fb4b2cd66e764d6ad9f69d6a747: Status 404 returned error can't find the container with id eaa35047055d1f045350930d28cca8379cdd4fb4b2cd66e764d6ad9f69d6a747
Sep 19 15:22:25.040131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:25.040116    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 15:22:25.674931 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:25.674890    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:25.733358 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:25.733317    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hssgm" event={"ID":"81afd963-013e-4e1c-b01e-fa8bfb068544","Type":"ContainerStarted","Data":"eaa35047055d1f045350930d28cca8379cdd4fb4b2cd66e764d6ad9f69d6a747"}
Sep 19 15:22:25.774879 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:25.774854    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:25.893059 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:25.893030    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:27.744004 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:27.743972    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hssgm" event={"ID":"81afd963-013e-4e1c-b01e-fa8bfb068544","Type":"ContainerStarted","Data":"de6ec773f622772c070c0a0dc85889e444f3e3ad9c141273222a95edf1d61561"}
Sep 19 15:22:27.744432 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:27.744106    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hssgm"
Sep 19 15:22:27.758708 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:27.758665    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hssgm" podStartSLOduration=1.789436708 podStartE2EDuration="3.758653834s" totalImagesPullingTime="1.969217126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:22:27.756868315 +0000 UTC m=+610.920283356" watchObservedRunningTime="2026-09-19 15:22:27.758653834 +0000 UTC m=+610.922068874"
Sep 19 15:22:28.693695 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:28.693668    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7b79856b6-vd6hb"
Sep 19 15:22:29.256017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:29.255986    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:22:32.716480 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:32.716452    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-hht6k"
Sep 19 15:22:32.718821 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:32.718800    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-6h2sw"
Sep 19 15:22:33.699409 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:33.699367    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66f6b5b6bd-v4c5t" podUID="e21b840e-71bb-49d9-98a5-93238c688336" containerName="console" containerID="cri-o://5318eee11bfb9030120a0e19375eb5a33d1b6ba3fc1905d56396ff35e6a74f3d" gracePeriod=15
Sep 19 15:22:33.947685 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:33.947664    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:22:33.985956 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:33.985891    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-service-ca\") pod \"e21b840e-71bb-49d9-98a5-93238c688336\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") "
Sep 19 15:22:33.985956 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:33.985921    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-trusted-ca-bundle\") pod \"e21b840e-71bb-49d9-98a5-93238c688336\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") "
Sep 19 15:22:33.986228 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:33.985977    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e21b840e-71bb-49d9-98a5-93238c688336-console-serving-cert\") pod \"e21b840e-71bb-49d9-98a5-93238c688336\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") "
Sep 19 15:22:33.986228 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:33.985997    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqm25\" (UniqueName: \"kubernetes.io/projected/e21b840e-71bb-49d9-98a5-93238c688336-kube-api-access-bqm25\") pod \"e21b840e-71bb-49d9-98a5-93238c688336\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") "
Sep 19 15:22:33.986228 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:33.986026    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-console-config\") pod \"e21b840e-71bb-49d9-98a5-93238c688336\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") "
Sep 19 15:22:33.986228 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:33.986072    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-oauth-serving-cert\") pod \"e21b840e-71bb-49d9-98a5-93238c688336\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") "
Sep 19 15:22:33.986228 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:33.986098    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e21b840e-71bb-49d9-98a5-93238c688336-console-oauth-config\") pod \"e21b840e-71bb-49d9-98a5-93238c688336\" (UID: \"e21b840e-71bb-49d9-98a5-93238c688336\") "
Sep 19 15:22:33.986500 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:33.986411    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-service-ca" (OuterVolumeSpecName: "service-ca") pod "e21b840e-71bb-49d9-98a5-93238c688336" (UID: "e21b840e-71bb-49d9-98a5-93238c688336"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:22:33.986554 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:33.986531    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e21b840e-71bb-49d9-98a5-93238c688336" (UID: "e21b840e-71bb-49d9-98a5-93238c688336"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:22:33.986636 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:33.986604    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e21b840e-71bb-49d9-98a5-93238c688336" (UID: "e21b840e-71bb-49d9-98a5-93238c688336"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:22:33.986766 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:33.986740    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-console-config" (OuterVolumeSpecName: "console-config") pod "e21b840e-71bb-49d9-98a5-93238c688336" (UID: "e21b840e-71bb-49d9-98a5-93238c688336"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:22:33.988369 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:33.988338    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e21b840e-71bb-49d9-98a5-93238c688336-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e21b840e-71bb-49d9-98a5-93238c688336" (UID: "e21b840e-71bb-49d9-98a5-93238c688336"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:22:33.988873 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:33.988856    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e21b840e-71bb-49d9-98a5-93238c688336-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e21b840e-71bb-49d9-98a5-93238c688336" (UID: "e21b840e-71bb-49d9-98a5-93238c688336"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:22:33.988937 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:33.988887    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e21b840e-71bb-49d9-98a5-93238c688336-kube-api-access-bqm25" (OuterVolumeSpecName: "kube-api-access-bqm25") pod "e21b840e-71bb-49d9-98a5-93238c688336" (UID: "e21b840e-71bb-49d9-98a5-93238c688336"). InnerVolumeSpecName "kube-api-access-bqm25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:22:34.086978 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:34.086958    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e21b840e-71bb-49d9-98a5-93238c688336-console-serving-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:22:34.086978 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:34.086979    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqm25\" (UniqueName: \"kubernetes.io/projected/e21b840e-71bb-49d9-98a5-93238c688336-kube-api-access-bqm25\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:22:34.087120 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:34.086988    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-console-config\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:22:34.087120 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:34.086998    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-oauth-serving-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:22:34.087120 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:34.087007    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e21b840e-71bb-49d9-98a5-93238c688336-console-oauth-config\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:22:34.087120 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:34.087015    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:22:34.087120 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:34.087026    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e21b840e-71bb-49d9-98a5-93238c688336-trusted-ca-bundle\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:22:34.777571 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:34.777530    2562 generic.go:356] "Generic (PLEG): container finished" podID="e21b840e-71bb-49d9-98a5-93238c688336" containerID="5318eee11bfb9030120a0e19375eb5a33d1b6ba3fc1905d56396ff35e6a74f3d" exitCode=0
Sep 19 15:22:34.777571 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:34.777571    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f6b5b6bd-v4c5t"
Sep 19 15:22:34.777810 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:34.777569    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f6b5b6bd-v4c5t" event={"ID":"e21b840e-71bb-49d9-98a5-93238c688336","Type":"ContainerDied","Data":"5318eee11bfb9030120a0e19375eb5a33d1b6ba3fc1905d56396ff35e6a74f3d"}
Sep 19 15:22:34.777810 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:34.777628    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f6b5b6bd-v4c5t" event={"ID":"e21b840e-71bb-49d9-98a5-93238c688336","Type":"ContainerDied","Data":"30c19dff891b00d1808e76759da83c45d00719c306e65a5679246574cfed6d64"}
Sep 19 15:22:34.777810 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:34.777656    2562 scope.go:117] "RemoveContainer" containerID="5318eee11bfb9030120a0e19375eb5a33d1b6ba3fc1905d56396ff35e6a74f3d"
Sep 19 15:22:34.787152 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:34.787138    2562 scope.go:117] "RemoveContainer" containerID="5318eee11bfb9030120a0e19375eb5a33d1b6ba3fc1905d56396ff35e6a74f3d"
Sep 19 15:22:34.787425 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:22:34.787410    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5318eee11bfb9030120a0e19375eb5a33d1b6ba3fc1905d56396ff35e6a74f3d\": container with ID starting with 5318eee11bfb9030120a0e19375eb5a33d1b6ba3fc1905d56396ff35e6a74f3d not found: ID does not exist" containerID="5318eee11bfb9030120a0e19375eb5a33d1b6ba3fc1905d56396ff35e6a74f3d"
Sep 19 15:22:34.787478 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:34.787432    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5318eee11bfb9030120a0e19375eb5a33d1b6ba3fc1905d56396ff35e6a74f3d"} err="failed to get container status \"5318eee11bfb9030120a0e19375eb5a33d1b6ba3fc1905d56396ff35e6a74f3d\": rpc error: code = NotFound desc = could not find container \"5318eee11bfb9030120a0e19375eb5a33d1b6ba3fc1905d56396ff35e6a74f3d\": container with ID starting with 5318eee11bfb9030120a0e19375eb5a33d1b6ba3fc1905d56396ff35e6a74f3d not found: ID does not exist"
Sep 19 15:22:34.798572 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:34.798552    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66f6b5b6bd-v4c5t"]
Sep 19 15:22:34.801869 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:34.801846    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66f6b5b6bd-v4c5t"]
Sep 19 15:22:35.343477 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:35.343446    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e21b840e-71bb-49d9-98a5-93238c688336" path="/var/lib/kubelet/pods/e21b840e-71bb-49d9-98a5-93238c688336/volumes"
Sep 19 15:22:58.753261 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:22:58.753170    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hssgm"
Sep 19 15:23:10.324918 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:10.324885    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:10.422070 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:10.422038    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:12.274174 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:12.274133    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:12.374508 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:12.374479    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:16.470593 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:16.470551    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:16.526187 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:16.526157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:29.856441 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:29.856392    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:32.433998 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:32.433963    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:32.824383 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:32.824351    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:33.214117 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:33.214038    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:35.764675 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:35.764638    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"]
Sep 19 15:23:35.765103 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:35.765010    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e21b840e-71bb-49d9-98a5-93238c688336" containerName="console"
Sep 19 15:23:35.765103 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:35.765021    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e21b840e-71bb-49d9-98a5-93238c688336" containerName="console"
Sep 19 15:23:35.765103 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:35.765088    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e21b840e-71bb-49d9-98a5-93238c688336" containerName="console"
Sep 19 15:23:35.769331 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:35.769315    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:35.772215 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:35.772180    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9vsnk\""
Sep 19 15:23:35.772359 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:35.772339    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 19 15:23:35.772436 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:35.772350    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 19 15:23:35.781784 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:35.781764    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c383f9f-07e9-4277-93e4-a93f9340f2b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xw56q\" (UID: \"0c383f9f-07e9-4277-93e4-a93f9340f2b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:35.781867 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:35.781792    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tm8w\" (UniqueName: \"kubernetes.io/projected/0c383f9f-07e9-4277-93e4-a93f9340f2b5-kube-api-access-4tm8w\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xw56q\" (UID: \"0c383f9f-07e9-4277-93e4-a93f9340f2b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:35.793867 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:35.793838    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"]
Sep 19 15:23:35.882453 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:35.882422    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c383f9f-07e9-4277-93e4-a93f9340f2b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xw56q\" (UID: \"0c383f9f-07e9-4277-93e4-a93f9340f2b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:35.882613 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:35.882463    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tm8w\" (UniqueName: \"kubernetes.io/projected/0c383f9f-07e9-4277-93e4-a93f9340f2b5-kube-api-access-4tm8w\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xw56q\" (UID: \"0c383f9f-07e9-4277-93e4-a93f9340f2b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:35.882778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:35.882761    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c383f9f-07e9-4277-93e4-a93f9340f2b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xw56q\" (UID: \"0c383f9f-07e9-4277-93e4-a93f9340f2b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:35.891009 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:35.890977    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tm8w\" (UniqueName: \"kubernetes.io/projected/0c383f9f-07e9-4277-93e4-a93f9340f2b5-kube-api-access-4tm8w\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xw56q\" (UID: \"0c383f9f-07e9-4277-93e4-a93f9340f2b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:36.079067 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:36.079033    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:36.260589 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:36.260553    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:36.353563 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:36.353541    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"]
Sep 19 15:23:36.356585 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:23:36.356552    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c383f9f_07e9_4277_93e4_a93f9340f2b5.slice/crio-f257614df0e4a99e0dbe3bd4920e4bc04cec8114318371286b11084a2c0416fb WatchSource:0}: Error finding container f257614df0e4a99e0dbe3bd4920e4bc04cec8114318371286b11084a2c0416fb: Status 404 returned error can't find the container with id f257614df0e4a99e0dbe3bd4920e4bc04cec8114318371286b11084a2c0416fb
Sep 19 15:23:36.417028 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:36.417003    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:37.066887 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:37.066853    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q" event={"ID":"0c383f9f-07e9-4277-93e4-a93f9340f2b5","Type":"ContainerStarted","Data":"f257614df0e4a99e0dbe3bd4920e4bc04cec8114318371286b11084a2c0416fb"}
Sep 19 15:23:37.333358 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:37.333276    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:38.215482 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:38.215434    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:38.620817 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:38.620747    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:38.843500 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:38.843466    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:40.245566 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:40.245524    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:41.098251 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:41.098218    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q" event={"ID":"0c383f9f-07e9-4277-93e4-a93f9340f2b5","Type":"ContainerStarted","Data":"81c22cd879b1c563bc628f010512633956b972445c399dbc3513b3224c67fd1c"}
Sep 19 15:23:41.098416 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:41.098337    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:41.117429 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:41.117359    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q" podStartSLOduration=2.02690692 podStartE2EDuration="6.117342965s" totalImagesPullingTime="4.090436045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:23:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:23:41.115909891 +0000 UTC m=+684.279324934" watchObservedRunningTime="2026-09-19 15:23:41.117342965 +0000 UTC m=+684.280758009"
Sep 19 15:23:42.229300 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:42.229267    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:42.333121 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:42.333090    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:43.162860 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:43.162814    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:43.709299 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:43.709270    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:46.014840 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:46.014811    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:46.069078 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:46.069045    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:46.411337 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:46.411280    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:46.512849 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:46.512810    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:46.824144 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:46.824105    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:46.879501 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:46.879474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:52.104936 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:52.104908    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:52.268008 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:52.267944    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:52.368593 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:52.368520    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:52.927071 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:52.927034    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:53.640647 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.640614    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nr89d"]
Sep 19 15:23:53.643963 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.643945    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nr89d"
Sep 19 15:23:53.655583 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.655563    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nr89d"]
Sep 19 15:23:53.734799 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.734770    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p88mg\" (UniqueName: \"kubernetes.io/projected/07314796-f01a-44e3-972a-511b0ca54c9b-kube-api-access-p88mg\") pod \"kuadrant-operator-controller-manager-5f685c496f-nr89d\" (UID: \"07314796-f01a-44e3-972a-511b0ca54c9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nr89d"
Sep 19 15:23:53.734946 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.734827    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07314796-f01a-44e3-972a-511b0ca54c9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-nr89d\" (UID: \"07314796-f01a-44e3-972a-511b0ca54c9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nr89d"
Sep 19 15:23:53.758056 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.758023    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nr89d"]
Sep 19 15:23:53.758302 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:23:53.758283    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-p88mg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nr89d" podUID="07314796-f01a-44e3-972a-511b0ca54c9b"
Sep 19 15:23:53.790316 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.790287    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"]
Sep 19 15:23:53.793530 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.793513    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"
Sep 19 15:23:53.804032 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.804011    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"]
Sep 19 15:23:53.835389 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.835359    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07314796-f01a-44e3-972a-511b0ca54c9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-nr89d\" (UID: \"07314796-f01a-44e3-972a-511b0ca54c9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nr89d"
Sep 19 15:23:53.835518 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.835414    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2768c949-8fcc-46a3-85f6-b89a5cc00f05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-25552\" (UID: \"2768c949-8fcc-46a3-85f6-b89a5cc00f05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"
Sep 19 15:23:53.835518 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.835463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9xdq\" (UniqueName: \"kubernetes.io/projected/2768c949-8fcc-46a3-85f6-b89a5cc00f05-kube-api-access-v9xdq\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-25552\" (UID: \"2768c949-8fcc-46a3-85f6-b89a5cc00f05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"
Sep 19 15:23:53.835518 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.835495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p88mg\" (UniqueName: \"kubernetes.io/projected/07314796-f01a-44e3-972a-511b0ca54c9b-kube-api-access-p88mg\") pod \"kuadrant-operator-controller-manager-5f685c496f-nr89d\" (UID: \"07314796-f01a-44e3-972a-511b0ca54c9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nr89d"
Sep 19 15:23:53.835778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.835759    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07314796-f01a-44e3-972a-511b0ca54c9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-nr89d\" (UID: \"07314796-f01a-44e3-972a-511b0ca54c9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nr89d"
Sep 19 15:23:53.844760 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.844741    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p88mg\" (UniqueName: \"kubernetes.io/projected/07314796-f01a-44e3-972a-511b0ca54c9b-kube-api-access-p88mg\") pod \"kuadrant-operator-controller-manager-5f685c496f-nr89d\" (UID: \"07314796-f01a-44e3-972a-511b0ca54c9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nr89d"
Sep 19 15:23:53.936062 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.935983    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2768c949-8fcc-46a3-85f6-b89a5cc00f05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-25552\" (UID: \"2768c949-8fcc-46a3-85f6-b89a5cc00f05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"
Sep 19 15:23:53.936349 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.936329    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9xdq\" (UniqueName: \"kubernetes.io/projected/2768c949-8fcc-46a3-85f6-b89a5cc00f05-kube-api-access-v9xdq\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-25552\" (UID: \"2768c949-8fcc-46a3-85f6-b89a5cc00f05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"
Sep 19 15:23:53.937215 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.937178    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2768c949-8fcc-46a3-85f6-b89a5cc00f05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-25552\" (UID: \"2768c949-8fcc-46a3-85f6-b89a5cc00f05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"
Sep 19 15:23:53.948448 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:53.948423    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9xdq\" (UniqueName: \"kubernetes.io/projected/2768c949-8fcc-46a3-85f6-b89a5cc00f05-kube-api-access-v9xdq\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-25552\" (UID: \"2768c949-8fcc-46a3-85f6-b89a5cc00f05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"
Sep 19 15:23:54.103372 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.103346    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"
Sep 19 15:23:54.157960 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.157932    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nr89d"
Sep 19 15:23:54.168994 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.168971    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nr89d"
Sep 19 15:23:54.192650 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.192586    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nr89d"]
Sep 19 15:23:54.198363 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.198341    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nr89d"]
Sep 19 15:23:54.210827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.210800    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"]
Sep 19 15:23:54.211031 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.211006    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q" podUID="0c383f9f-07e9-4277-93e4-a93f9340f2b5" containerName="manager" containerID="cri-o://81c22cd879b1c563bc628f010512633956b972445c399dbc3513b3224c67fd1c" gracePeriod=2
Sep 19 15:23:54.218910 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.218886    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"]
Sep 19 15:23:54.219547 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:23:54.219246    2562 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0c383f9f-07e9-4277-93e4-a93f9340f2b5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-xw56q\": pods \"kuadrant-operator-controller-manager-76f8f686bf-xw56q\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:54.234375 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.234350    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"]
Sep 19 15:23:54.235825 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.235807    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"]
Sep 19 15:23:54.236185 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.236173    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c383f9f-07e9-4277-93e4-a93f9340f2b5" containerName="manager"
Sep 19 15:23:54.236247 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.236189    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c383f9f-07e9-4277-93e4-a93f9340f2b5" containerName="manager"
Sep 19 15:23:54.236282 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.236264    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c383f9f-07e9-4277-93e4-a93f9340f2b5" containerName="manager"
Sep 19 15:23:54.239352 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.239336    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"
Sep 19 15:23:54.239519 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.239500    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07314796-f01a-44e3-972a-511b0ca54c9b-extensions-socket-volume\") pod \"07314796-f01a-44e3-972a-511b0ca54c9b\" (UID: \"07314796-f01a-44e3-972a-511b0ca54c9b\") "
Sep 19 15:23:54.239670 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.239655    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p88mg\" (UniqueName: \"kubernetes.io/projected/07314796-f01a-44e3-972a-511b0ca54c9b-kube-api-access-p88mg\") pod \"07314796-f01a-44e3-972a-511b0ca54c9b\" (UID: \"07314796-f01a-44e3-972a-511b0ca54c9b\") "
Sep 19 15:23:54.239807 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.239758    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07314796-f01a-44e3-972a-511b0ca54c9b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "07314796-f01a-44e3-972a-511b0ca54c9b" (UID: "07314796-f01a-44e3-972a-511b0ca54c9b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:23:54.239946 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.239914    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07314796-f01a-44e3-972a-511b0ca54c9b-extensions-socket-volume\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:23:54.241750 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:23:54.241721    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xw56q\" is forbidden: User \"system:node:ip-10-0-132-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-152.ec2.internal' and this object" podUID="0c383f9f-07e9-4277-93e4-a93f9340f2b5" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:54.242079 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.242057    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07314796-f01a-44e3-972a-511b0ca54c9b-kube-api-access-p88mg" (OuterVolumeSpecName: "kube-api-access-p88mg") pod "07314796-f01a-44e3-972a-511b0ca54c9b" (UID: "07314796-f01a-44e3-972a-511b0ca54c9b"). InnerVolumeSpecName "kube-api-access-p88mg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:23:54.242536 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.242516    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"]
Sep 19 15:23:54.253847 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.253828    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"]
Sep 19 15:23:54.259957 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.259935    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"]
Sep 19 15:23:54.263187 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.263171    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"
Sep 19 15:23:54.279234 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.279212    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"]
Sep 19 15:23:54.302951 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:23:54.302922    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xw56q\" is forbidden: User \"system:node:ip-10-0-132-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-152.ec2.internal' and this object" podUID="0c383f9f-07e9-4277-93e4-a93f9340f2b5" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:54.341364 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.341330    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxhtn\" (UniqueName: \"kubernetes.io/projected/7b07d73b-cb47-458b-ae74-7a3228f7d413-kube-api-access-bxhtn\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-v65g9\" (UID: \"7b07d73b-cb47-458b-ae74-7a3228f7d413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"
Sep 19 15:23:54.341485 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.341464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fffd45c5-962c-4a6f-8509-6a805dc5970a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d2c9j\" (UID: \"fffd45c5-962c-4a6f-8509-6a805dc5970a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"
Sep 19 15:23:54.341563 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.341513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8shc\" (UniqueName: \"kubernetes.io/projected/fffd45c5-962c-4a6f-8509-6a805dc5970a-kube-api-access-n8shc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d2c9j\" (UID: \"fffd45c5-962c-4a6f-8509-6a805dc5970a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"
Sep 19 15:23:54.341563 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.341556    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b07d73b-cb47-458b-ae74-7a3228f7d413-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-v65g9\" (UID: \"7b07d73b-cb47-458b-ae74-7a3228f7d413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"
Sep 19 15:23:54.341669 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.341601    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p88mg\" (UniqueName: \"kubernetes.io/projected/07314796-f01a-44e3-972a-511b0ca54c9b-kube-api-access-p88mg\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:23:54.439472 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.439450    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:54.441419 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:23:54.441395    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xw56q\" is forbidden: User \"system:node:ip-10-0-132-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-152.ec2.internal' and this object" podUID="0c383f9f-07e9-4277-93e4-a93f9340f2b5" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:54.442943 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.442879    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fffd45c5-962c-4a6f-8509-6a805dc5970a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d2c9j\" (UID: \"fffd45c5-962c-4a6f-8509-6a805dc5970a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"
Sep 19 15:23:54.443087 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.443061    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8shc\" (UniqueName: \"kubernetes.io/projected/fffd45c5-962c-4a6f-8509-6a805dc5970a-kube-api-access-n8shc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d2c9j\" (UID: \"fffd45c5-962c-4a6f-8509-6a805dc5970a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"
Sep 19 15:23:54.443230 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.443130    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b07d73b-cb47-458b-ae74-7a3228f7d413-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-v65g9\" (UID: \"7b07d73b-cb47-458b-ae74-7a3228f7d413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"
Sep 19 15:23:54.443305 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.443260    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxhtn\" (UniqueName: \"kubernetes.io/projected/7b07d73b-cb47-458b-ae74-7a3228f7d413-kube-api-access-bxhtn\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-v65g9\" (UID: \"7b07d73b-cb47-458b-ae74-7a3228f7d413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"
Sep 19 15:23:54.443305 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.443280    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fffd45c5-962c-4a6f-8509-6a805dc5970a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d2c9j\" (UID: \"fffd45c5-962c-4a6f-8509-6a805dc5970a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"
Sep 19 15:23:54.443655 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.443519    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b07d73b-cb47-458b-ae74-7a3228f7d413-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-v65g9\" (UID: \"7b07d73b-cb47-458b-ae74-7a3228f7d413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"
Sep 19 15:23:54.451322 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.451299    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8shc\" (UniqueName: \"kubernetes.io/projected/fffd45c5-962c-4a6f-8509-6a805dc5970a-kube-api-access-n8shc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d2c9j\" (UID: \"fffd45c5-962c-4a6f-8509-6a805dc5970a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"
Sep 19 15:23:54.451423 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.451305    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxhtn\" (UniqueName: \"kubernetes.io/projected/7b07d73b-cb47-458b-ae74-7a3228f7d413-kube-api-access-bxhtn\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-v65g9\" (UID: \"7b07d73b-cb47-458b-ae74-7a3228f7d413\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"
Sep 19 15:23:54.485461 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:23:54.485432    2562 log.go:32] "RunPodSandbox from runtime service failed" err=<
Sep 19 15:23:54.485461 ip-10-0-132-152 kubenswrapper[2562]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-25552_kuadrant-system_2768c949-8fcc-46a3-85f6-b89a5cc00f05_0(3704a204922b60a96111e855ec35af395352860eba0bea1269340c0bbdf24446): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-25552 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3704a204922b60a96111e855ec35af395352860eba0bea1269340c0bbdf24446" Netns:"/var/run/netns/c2cdfeec-1d2a-4942-a227-12b836b5020a" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-25552;K8S_POD_INFRA_CONTAINER_ID=3704a204922b60a96111e855ec35af395352860eba0bea1269340c0bbdf24446;K8S_POD_UID=2768c949-8fcc-46a3-85f6-b89a5cc00f05" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552/2768c949-8fcc-46a3-85f6-b89a5cc00f05:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552 3704a204922b60a96111e855ec35af395352860eba0bea1269340c0bbdf24446 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:24 [10.133.0.36/23]
Sep 19 15:23:54.485461 ip-10-0-132-152 kubenswrapper[2562]:         '
Sep 19 15:23:54.485461 ip-10-0-132-152 kubenswrapper[2562]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 19 15:23:54.485461 ip-10-0-132-152 kubenswrapper[2562]:  >
Sep 19 15:23:54.485639 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:23:54.485491    2562 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Sep 19 15:23:54.485639 ip-10-0-132-152 kubenswrapper[2562]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-25552_kuadrant-system_2768c949-8fcc-46a3-85f6-b89a5cc00f05_0(3704a204922b60a96111e855ec35af395352860eba0bea1269340c0bbdf24446): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-25552 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3704a204922b60a96111e855ec35af395352860eba0bea1269340c0bbdf24446" Netns:"/var/run/netns/c2cdfeec-1d2a-4942-a227-12b836b5020a" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-25552;K8S_POD_INFRA_CONTAINER_ID=3704a204922b60a96111e855ec35af395352860eba0bea1269340c0bbdf24446;K8S_POD_UID=2768c949-8fcc-46a3-85f6-b89a5cc00f05" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552/2768c949-8fcc-46a3-85f6-b89a5cc00f05:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552 3704a204922b60a96111e855ec35af395352860eba0bea1269340c0bbdf24446 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:24 [10.133.0.36/23]
Sep 19 15:23:54.485639 ip-10-0-132-152 kubenswrapper[2562]:         '
Sep 19 15:23:54.485639 ip-10-0-132-152 kubenswrapper[2562]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 19 15:23:54.485639 ip-10-0-132-152 kubenswrapper[2562]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"
Sep 19 15:23:54.544029 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.544007    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tm8w\" (UniqueName: \"kubernetes.io/projected/0c383f9f-07e9-4277-93e4-a93f9340f2b5-kube-api-access-4tm8w\") pod \"0c383f9f-07e9-4277-93e4-a93f9340f2b5\" (UID: \"0c383f9f-07e9-4277-93e4-a93f9340f2b5\") "
Sep 19 15:23:54.544143 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.544044    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c383f9f-07e9-4277-93e4-a93f9340f2b5-extensions-socket-volume\") pod \"0c383f9f-07e9-4277-93e4-a93f9340f2b5\" (UID: \"0c383f9f-07e9-4277-93e4-a93f9340f2b5\") "
Sep 19 15:23:54.544549 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.544523    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c383f9f-07e9-4277-93e4-a93f9340f2b5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0c383f9f-07e9-4277-93e4-a93f9340f2b5" (UID: "0c383f9f-07e9-4277-93e4-a93f9340f2b5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:23:54.546208 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.546179    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c383f9f-07e9-4277-93e4-a93f9340f2b5-kube-api-access-4tm8w" (OuterVolumeSpecName: "kube-api-access-4tm8w") pod "0c383f9f-07e9-4277-93e4-a93f9340f2b5" (UID: "0c383f9f-07e9-4277-93e4-a93f9340f2b5"). InnerVolumeSpecName "kube-api-access-4tm8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:23:54.596447 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.596426    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"
Sep 19 15:23:54.605561 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.605542    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"
Sep 19 15:23:54.645834 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.645798    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c383f9f-07e9-4277-93e4-a93f9340f2b5-extensions-socket-volume\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:23:54.646171 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.645840    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tm8w\" (UniqueName: \"kubernetes.io/projected/0c383f9f-07e9-4277-93e4-a93f9340f2b5-kube-api-access-4tm8w\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:23:54.886590 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.886570    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"]
Sep 19 15:23:54.889306 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:23:54.889284    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfffd45c5_962c_4a6f_8509_6a805dc5970a.slice/crio-60aafbbef5bb09b0f8f3b8bd900afebedc541de70086cdbb56bb0e1e757e211d WatchSource:0}: Error finding container 60aafbbef5bb09b0f8f3b8bd900afebedc541de70086cdbb56bb0e1e757e211d: Status 404 returned error can't find the container with id 60aafbbef5bb09b0f8f3b8bd900afebedc541de70086cdbb56bb0e1e757e211d
Sep 19 15:23:54.892096 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:54.892076    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"]
Sep 19 15:23:54.894812 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:23:54.894791    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b07d73b_cb47_458b_ae74_7a3228f7d413.slice/crio-270ef290c5929e518b47315632d380aa4baf8517787c43abdda99a74174d9431 WatchSource:0}: Error finding container 270ef290c5929e518b47315632d380aa4baf8517787c43abdda99a74174d9431: Status 404 returned error can't find the container with id 270ef290c5929e518b47315632d380aa4baf8517787c43abdda99a74174d9431
Sep 19 15:23:55.167491 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.167405    2562 generic.go:356] "Generic (PLEG): container finished" podID="0c383f9f-07e9-4277-93e4-a93f9340f2b5" containerID="81c22cd879b1c563bc628f010512633956b972445c399dbc3513b3224c67fd1c" exitCode=0
Sep 19 15:23:55.167491 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.167453    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:55.167727 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.167508    2562 scope.go:117] "RemoveContainer" containerID="81c22cd879b1c563bc628f010512633956b972445c399dbc3513b3224c67fd1c"
Sep 19 15:23:55.175958 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:23:55.170077    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xw56q\" is forbidden: User \"system:node:ip-10-0-132-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-152.ec2.internal' and this object" podUID="0c383f9f-07e9-4277-93e4-a93f9340f2b5" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:55.176628 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.176598    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9" event={"ID":"7b07d73b-cb47-458b-ae74-7a3228f7d413","Type":"ContainerStarted","Data":"5cfc063d2d783fd821a69fb02de9931dfc53529abdcc51bac17ab61f028d7cd5"}
Sep 19 15:23:55.176866 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.176846    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"
Sep 19 15:23:55.176973 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.176879    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9" event={"ID":"7b07d73b-cb47-458b-ae74-7a3228f7d413","Type":"ContainerStarted","Data":"270ef290c5929e518b47315632d380aa4baf8517787c43abdda99a74174d9431"}
Sep 19 15:23:55.178587 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.178565    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j" event={"ID":"fffd45c5-962c-4a6f-8509-6a805dc5970a","Type":"ContainerStarted","Data":"e3bd0a5aeb85b310f5e62b549ba30d41e1d66425e6200fc0ce9cb89e8114cc5e"}
Sep 19 15:23:55.178685 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.178661    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j" event={"ID":"fffd45c5-962c-4a6f-8509-6a805dc5970a","Type":"ContainerStarted","Data":"60aafbbef5bb09b0f8f3b8bd900afebedc541de70086cdbb56bb0e1e757e211d"}
Sep 19 15:23:55.178744 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.178725    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"
Sep 19 15:23:55.178852 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.178831    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"
Sep 19 15:23:55.178966 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.178944    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nr89d"
Sep 19 15:23:55.180245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.180219    2562 scope.go:117] "RemoveContainer" containerID="81c22cd879b1c563bc628f010512633956b972445c399dbc3513b3224c67fd1c"
Sep 19 15:23:55.180552 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:23:55.180531    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81c22cd879b1c563bc628f010512633956b972445c399dbc3513b3224c67fd1c\": container with ID starting with 81c22cd879b1c563bc628f010512633956b972445c399dbc3513b3224c67fd1c not found: ID does not exist" containerID="81c22cd879b1c563bc628f010512633956b972445c399dbc3513b3224c67fd1c"
Sep 19 15:23:55.180629 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.180561    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81c22cd879b1c563bc628f010512633956b972445c399dbc3513b3224c67fd1c"} err="failed to get container status \"81c22cd879b1c563bc628f010512633956b972445c399dbc3513b3224c67fd1c\": rpc error: code = NotFound desc = could not find container \"81c22cd879b1c563bc628f010512633956b972445c399dbc3513b3224c67fd1c\": container with ID starting with 81c22cd879b1c563bc628f010512633956b972445c399dbc3513b3224c67fd1c not found: ID does not exist"
Sep 19 15:23:55.187532 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.187516    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"
Sep 19 15:23:55.195314 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.195267    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9" podStartSLOduration=1.195252254 podStartE2EDuration="1.195252254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:23:55.194018196 +0000 UTC m=+698.357433245" watchObservedRunningTime="2026-09-19 15:23:55.195252254 +0000 UTC m=+698.358667295"
Sep 19 15:23:55.196189 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:23:55.196159    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xw56q\" is forbidden: User \"system:node:ip-10-0-132-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-152.ec2.internal' and this object" podUID="0c383f9f-07e9-4277-93e4-a93f9340f2b5" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:55.215559 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.215517    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j" podStartSLOduration=1.215505351 podStartE2EDuration="1.215505351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:23:55.214818878 +0000 UTC m=+698.378233919" watchObservedRunningTime="2026-09-19 15:23:55.215505351 +0000 UTC m=+698.378920391"
Sep 19 15:23:55.216640 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:23:55.216616    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xw56q\" is forbidden: User \"system:node:ip-10-0-132-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-152.ec2.internal' and this object" podUID="0c383f9f-07e9-4277-93e4-a93f9340f2b5" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xw56q"
Sep 19 15:23:55.218101 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:23:55.218081    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-nr89d\" is forbidden: User \"system:node:ip-10-0-132-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-152.ec2.internal' and this object" podUID="07314796-f01a-44e3-972a-511b0ca54c9b" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-nr89d"
Sep 19 15:23:55.219493 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:23:55.219477    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-25552\" is forbidden: User \"system:node:ip-10-0-132-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-152.ec2.internal' and this object" podUID="2768c949-8fcc-46a3-85f6-b89a5cc00f05" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"
Sep 19 15:23:55.251515 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.251490    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2768c949-8fcc-46a3-85f6-b89a5cc00f05-extensions-socket-volume\") pod \"2768c949-8fcc-46a3-85f6-b89a5cc00f05\" (UID: \"2768c949-8fcc-46a3-85f6-b89a5cc00f05\") "
Sep 19 15:23:55.251587 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.251542    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9xdq\" (UniqueName: \"kubernetes.io/projected/2768c949-8fcc-46a3-85f6-b89a5cc00f05-kube-api-access-v9xdq\") pod \"2768c949-8fcc-46a3-85f6-b89a5cc00f05\" (UID: \"2768c949-8fcc-46a3-85f6-b89a5cc00f05\") "
Sep 19 15:23:55.251777 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.251754    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2768c949-8fcc-46a3-85f6-b89a5cc00f05-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2768c949-8fcc-46a3-85f6-b89a5cc00f05" (UID: "2768c949-8fcc-46a3-85f6-b89a5cc00f05"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:23:55.253670 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.253647    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2768c949-8fcc-46a3-85f6-b89a5cc00f05-kube-api-access-v9xdq" (OuterVolumeSpecName: "kube-api-access-v9xdq") pod "2768c949-8fcc-46a3-85f6-b89a5cc00f05" (UID: "2768c949-8fcc-46a3-85f6-b89a5cc00f05"). InnerVolumeSpecName "kube-api-access-v9xdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:23:55.343790 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.343756    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07314796-f01a-44e3-972a-511b0ca54c9b" path="/var/lib/kubelet/pods/07314796-f01a-44e3-972a-511b0ca54c9b/volumes"
Sep 19 15:23:55.344006 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.343994    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c383f9f-07e9-4277-93e4-a93f9340f2b5" path="/var/lib/kubelet/pods/0c383f9f-07e9-4277-93e4-a93f9340f2b5/volumes"
Sep 19 15:23:55.344330 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.344318    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2768c949-8fcc-46a3-85f6-b89a5cc00f05" path="/var/lib/kubelet/pods/2768c949-8fcc-46a3-85f6-b89a5cc00f05/volumes"
Sep 19 15:23:55.352469 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.352450    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2768c949-8fcc-46a3-85f6-b89a5cc00f05-extensions-socket-volume\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:23:55.352469 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:55.352469    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9xdq\" (UniqueName: \"kubernetes.io/projected/2768c949-8fcc-46a3-85f6-b89a5cc00f05-kube-api-access-v9xdq\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:23:56.184066 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:56.183990    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"
Sep 19 15:23:56.187955 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:23:56.187917    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-25552\" is forbidden: User \"system:node:ip-10-0-132-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-152.ec2.internal' and this object" podUID="2768c949-8fcc-46a3-85f6-b89a5cc00f05" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"
Sep 19 15:23:57.342029 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:23:57.341995    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-25552\" is forbidden: User \"system:node:ip-10-0-132-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-152.ec2.internal' and this object" podUID="2768c949-8fcc-46a3-85f6-b89a5cc00f05" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-25552"
Sep 19 15:23:58.858641 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:58.858590    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:23:58.919214 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:23:58.919147    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:01.427157 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:01.427110    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:01.528550 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:01.528509    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:05.234340 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:05.234295    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:05.292878 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:05.292847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:05.434432 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:05.434398    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:05.484249 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:05.484224    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:06.186019 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.185990    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"
Sep 19 15:24:06.186181 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.186056    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"
Sep 19 15:24:06.253890 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.253861    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"]
Sep 19 15:24:06.254325 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.254071    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j" podUID="fffd45c5-962c-4a6f-8509-6a805dc5970a" containerName="manager" containerID="cri-o://e3bd0a5aeb85b310f5e62b549ba30d41e1d66425e6200fc0ce9cb89e8114cc5e" gracePeriod=10
Sep 19 15:24:06.435707 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.435681    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:06.498078 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.498058    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"
Sep 19 15:24:06.522715 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.522687    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:06.627896 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.627868    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"]
Sep 19 15:24:06.628401 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.628382    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fffd45c5-962c-4a6f-8509-6a805dc5970a" containerName="manager"
Sep 19 15:24:06.628481 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.628404    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fffd45c5-962c-4a6f-8509-6a805dc5970a" containerName="manager"
Sep 19 15:24:06.628540 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.628526    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fffd45c5-962c-4a6f-8509-6a805dc5970a" containerName="manager"
Sep 19 15:24:06.631789 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.631771    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"
Sep 19 15:24:06.645304 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.645283    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8shc\" (UniqueName: \"kubernetes.io/projected/fffd45c5-962c-4a6f-8509-6a805dc5970a-kube-api-access-n8shc\") pod \"fffd45c5-962c-4a6f-8509-6a805dc5970a\" (UID: \"fffd45c5-962c-4a6f-8509-6a805dc5970a\") "
Sep 19 15:24:06.645420 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.645341    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fffd45c5-962c-4a6f-8509-6a805dc5970a-extensions-socket-volume\") pod \"fffd45c5-962c-4a6f-8509-6a805dc5970a\" (UID: \"fffd45c5-962c-4a6f-8509-6a805dc5970a\") "
Sep 19 15:24:06.645706 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.645689    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fffd45c5-962c-4a6f-8509-6a805dc5970a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fffd45c5-962c-4a6f-8509-6a805dc5970a" (UID: "fffd45c5-962c-4a6f-8509-6a805dc5970a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:24:06.647372 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.647345    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fffd45c5-962c-4a6f-8509-6a805dc5970a-kube-api-access-n8shc" (OuterVolumeSpecName: "kube-api-access-n8shc") pod "fffd45c5-962c-4a6f-8509-6a805dc5970a" (UID: "fffd45c5-962c-4a6f-8509-6a805dc5970a"). InnerVolumeSpecName "kube-api-access-n8shc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:24:06.647633 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.647616    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"]
Sep 19 15:24:06.746752 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.746659    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nxld\" (UniqueName: \"kubernetes.io/projected/69b68d9e-2f15-4358-b7c9-be6739375abf-kube-api-access-5nxld\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9wmhp\" (UID: \"69b68d9e-2f15-4358-b7c9-be6739375abf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"
Sep 19 15:24:06.746752 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.746744    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69b68d9e-2f15-4358-b7c9-be6739375abf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9wmhp\" (UID: \"69b68d9e-2f15-4358-b7c9-be6739375abf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"
Sep 19 15:24:06.746926 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.746789    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8shc\" (UniqueName: \"kubernetes.io/projected/fffd45c5-962c-4a6f-8509-6a805dc5970a-kube-api-access-n8shc\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:24:06.746926 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.746799    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fffd45c5-962c-4a6f-8509-6a805dc5970a-extensions-socket-volume\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:24:06.847343 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.847304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69b68d9e-2f15-4358-b7c9-be6739375abf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9wmhp\" (UID: \"69b68d9e-2f15-4358-b7c9-be6739375abf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"
Sep 19 15:24:06.847499 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.847398    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nxld\" (UniqueName: \"kubernetes.io/projected/69b68d9e-2f15-4358-b7c9-be6739375abf-kube-api-access-5nxld\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9wmhp\" (UID: \"69b68d9e-2f15-4358-b7c9-be6739375abf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"
Sep 19 15:24:06.847745 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.847725    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69b68d9e-2f15-4358-b7c9-be6739375abf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9wmhp\" (UID: \"69b68d9e-2f15-4358-b7c9-be6739375abf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"
Sep 19 15:24:06.863665 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.863637    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nxld\" (UniqueName: \"kubernetes.io/projected/69b68d9e-2f15-4358-b7c9-be6739375abf-kube-api-access-5nxld\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9wmhp\" (UID: \"69b68d9e-2f15-4358-b7c9-be6739375abf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"
Sep 19 15:24:06.941275 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:06.941245    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"
Sep 19 15:24:07.222690 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:07.222594    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"]
Sep 19 15:24:07.225093 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:24:07.225064    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b68d9e_2f15_4358_b7c9_be6739375abf.slice/crio-49f2755da0cbb630d867bc809f390e4b7bdb052b99e796615e3d48c97a67809f WatchSource:0}: Error finding container 49f2755da0cbb630d867bc809f390e4b7bdb052b99e796615e3d48c97a67809f: Status 404 returned error can't find the container with id 49f2755da0cbb630d867bc809f390e4b7bdb052b99e796615e3d48c97a67809f
Sep 19 15:24:07.243938 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:07.243852    2562 generic.go:356] "Generic (PLEG): container finished" podID="fffd45c5-962c-4a6f-8509-6a805dc5970a" containerID="e3bd0a5aeb85b310f5e62b549ba30d41e1d66425e6200fc0ce9cb89e8114cc5e" exitCode=0
Sep 19 15:24:07.243938 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:07.243895    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"
Sep 19 15:24:07.244067 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:07.243941    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j" event={"ID":"fffd45c5-962c-4a6f-8509-6a805dc5970a","Type":"ContainerDied","Data":"e3bd0a5aeb85b310f5e62b549ba30d41e1d66425e6200fc0ce9cb89e8114cc5e"}
Sep 19 15:24:07.244067 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:07.244010    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j" event={"ID":"fffd45c5-962c-4a6f-8509-6a805dc5970a","Type":"ContainerDied","Data":"60aafbbef5bb09b0f8f3b8bd900afebedc541de70086cdbb56bb0e1e757e211d"}
Sep 19 15:24:07.244067 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:07.244043    2562 scope.go:117] "RemoveContainer" containerID="e3bd0a5aeb85b310f5e62b549ba30d41e1d66425e6200fc0ce9cb89e8114cc5e"
Sep 19 15:24:07.245552 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:07.245533    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp" event={"ID":"69b68d9e-2f15-4358-b7c9-be6739375abf","Type":"ContainerStarted","Data":"49f2755da0cbb630d867bc809f390e4b7bdb052b99e796615e3d48c97a67809f"}
Sep 19 15:24:07.269419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:07.269383    2562 scope.go:117] "RemoveContainer" containerID="e3bd0a5aeb85b310f5e62b549ba30d41e1d66425e6200fc0ce9cb89e8114cc5e"
Sep 19 15:24:07.269754 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:24:07.269733    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3bd0a5aeb85b310f5e62b549ba30d41e1d66425e6200fc0ce9cb89e8114cc5e\": container with ID starting with e3bd0a5aeb85b310f5e62b549ba30d41e1d66425e6200fc0ce9cb89e8114cc5e not found: ID does not exist" containerID="e3bd0a5aeb85b310f5e62b549ba30d41e1d66425e6200fc0ce9cb89e8114cc5e"
Sep 19 15:24:07.269810 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:07.269764    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3bd0a5aeb85b310f5e62b549ba30d41e1d66425e6200fc0ce9cb89e8114cc5e"} err="failed to get container status \"e3bd0a5aeb85b310f5e62b549ba30d41e1d66425e6200fc0ce9cb89e8114cc5e\": rpc error: code = NotFound desc = could not find container \"e3bd0a5aeb85b310f5e62b549ba30d41e1d66425e6200fc0ce9cb89e8114cc5e\": container with ID starting with e3bd0a5aeb85b310f5e62b549ba30d41e1d66425e6200fc0ce9cb89e8114cc5e not found: ID does not exist"
Sep 19 15:24:07.310032 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:07.310008    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"]
Sep 19 15:24:07.319125 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:07.319098    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d2c9j"]
Sep 19 15:24:07.344564 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:07.344541    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fffd45c5-962c-4a6f-8509-6a805dc5970a" path="/var/lib/kubelet/pods/fffd45c5-962c-4a6f-8509-6a805dc5970a/volumes"
Sep 19 15:24:08.252690 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:08.252656    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp" event={"ID":"69b68d9e-2f15-4358-b7c9-be6739375abf","Type":"ContainerStarted","Data":"461327dd43139b81f0040a73f1bc904380410919e715724395f835311e4eac4e"}
Sep 19 15:24:08.252874 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:08.252751    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"
Sep 19 15:24:08.272966 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:08.272918    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp" podStartSLOduration=2.272904261 podStartE2EDuration="2.272904261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:24:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:24:08.271697242 +0000 UTC m=+711.435112308" watchObservedRunningTime="2026-09-19 15:24:08.272904261 +0000 UTC m=+711.436319301"
Sep 19 15:24:13.275365 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:13.275324    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:13.375404 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:13.375374    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:19.260302 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:19.260267    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"
Sep 19 15:24:19.310097 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:19.310066    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"]
Sep 19 15:24:19.310319 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:19.310293    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9" podUID="7b07d73b-cb47-458b-ae74-7a3228f7d413" containerName="manager" containerID="cri-o://5cfc063d2d783fd821a69fb02de9931dfc53529abdcc51bac17ab61f028d7cd5" gracePeriod=10
Sep 19 15:24:19.550317 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:19.550291    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"
Sep 19 15:24:19.661098 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:19.661072    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxhtn\" (UniqueName: \"kubernetes.io/projected/7b07d73b-cb47-458b-ae74-7a3228f7d413-kube-api-access-bxhtn\") pod \"7b07d73b-cb47-458b-ae74-7a3228f7d413\" (UID: \"7b07d73b-cb47-458b-ae74-7a3228f7d413\") "
Sep 19 15:24:19.661098 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:19.661105    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b07d73b-cb47-458b-ae74-7a3228f7d413-extensions-socket-volume\") pod \"7b07d73b-cb47-458b-ae74-7a3228f7d413\" (UID: \"7b07d73b-cb47-458b-ae74-7a3228f7d413\") "
Sep 19 15:24:19.661866 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:19.661733    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b07d73b-cb47-458b-ae74-7a3228f7d413-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7b07d73b-cb47-458b-ae74-7a3228f7d413" (UID: "7b07d73b-cb47-458b-ae74-7a3228f7d413"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:24:19.663301 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:19.661984    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b07d73b-cb47-458b-ae74-7a3228f7d413-extensions-socket-volume\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:24:19.668405 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:19.668379    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b07d73b-cb47-458b-ae74-7a3228f7d413-kube-api-access-bxhtn" (OuterVolumeSpecName: "kube-api-access-bxhtn") pod "7b07d73b-cb47-458b-ae74-7a3228f7d413" (UID: "7b07d73b-cb47-458b-ae74-7a3228f7d413"). InnerVolumeSpecName "kube-api-access-bxhtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:24:19.762655 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:19.762626    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxhtn\" (UniqueName: \"kubernetes.io/projected/7b07d73b-cb47-458b-ae74-7a3228f7d413-kube-api-access-bxhtn\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:24:19.843248 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:19.843223    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:19.942371 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:19.942348    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:20.315909 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:20.315881    2562 generic.go:356] "Generic (PLEG): container finished" podID="7b07d73b-cb47-458b-ae74-7a3228f7d413" containerID="5cfc063d2d783fd821a69fb02de9931dfc53529abdcc51bac17ab61f028d7cd5" exitCode=0
Sep 19 15:24:20.316410 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:20.315948    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"
Sep 19 15:24:20.316410 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:20.315971    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9" event={"ID":"7b07d73b-cb47-458b-ae74-7a3228f7d413","Type":"ContainerDied","Data":"5cfc063d2d783fd821a69fb02de9931dfc53529abdcc51bac17ab61f028d7cd5"}
Sep 19 15:24:20.316410 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:20.316057    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9" event={"ID":"7b07d73b-cb47-458b-ae74-7a3228f7d413","Type":"ContainerDied","Data":"270ef290c5929e518b47315632d380aa4baf8517787c43abdda99a74174d9431"}
Sep 19 15:24:20.316410 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:20.316098    2562 scope.go:117] "RemoveContainer" containerID="5cfc063d2d783fd821a69fb02de9931dfc53529abdcc51bac17ab61f028d7cd5"
Sep 19 15:24:20.325332 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:20.325315    2562 scope.go:117] "RemoveContainer" containerID="5cfc063d2d783fd821a69fb02de9931dfc53529abdcc51bac17ab61f028d7cd5"
Sep 19 15:24:20.325640 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:24:20.325620    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cfc063d2d783fd821a69fb02de9931dfc53529abdcc51bac17ab61f028d7cd5\": container with ID starting with 5cfc063d2d783fd821a69fb02de9931dfc53529abdcc51bac17ab61f028d7cd5 not found: ID does not exist" containerID="5cfc063d2d783fd821a69fb02de9931dfc53529abdcc51bac17ab61f028d7cd5"
Sep 19 15:24:20.325700 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:20.325650    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cfc063d2d783fd821a69fb02de9931dfc53529abdcc51bac17ab61f028d7cd5"} err="failed to get container status \"5cfc063d2d783fd821a69fb02de9931dfc53529abdcc51bac17ab61f028d7cd5\": rpc error: code = NotFound desc = could not find container \"5cfc063d2d783fd821a69fb02de9931dfc53529abdcc51bac17ab61f028d7cd5\": container with ID starting with 5cfc063d2d783fd821a69fb02de9931dfc53529abdcc51bac17ab61f028d7cd5 not found: ID does not exist"
Sep 19 15:24:20.349969 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:20.349948    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"]
Sep 19 15:24:20.356392 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:20.356372    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-v65g9"]
Sep 19 15:24:21.344065 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:21.344036    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b07d73b-cb47-458b-ae74-7a3228f7d413" path="/var/lib/kubelet/pods/7b07d73b-cb47-458b-ae74-7a3228f7d413/volumes"
Sep 19 15:24:22.511970 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.511941    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"]
Sep 19 15:24:22.512468 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.512449    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b07d73b-cb47-458b-ae74-7a3228f7d413" containerName="manager"
Sep 19 15:24:22.512543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.512471    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b07d73b-cb47-458b-ae74-7a3228f7d413" containerName="manager"
Sep 19 15:24:22.512652 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.512613    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b07d73b-cb47-458b-ae74-7a3228f7d413" containerName="manager"
Sep 19 15:24:22.516831 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.516805    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.519000 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.518981    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7j4b6\""
Sep 19 15:24:22.526273 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.526252    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"]
Sep 19 15:24:22.544371 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.544345    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:22.643830 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.643803    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:22.686827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.686803    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0929386-81b6-467e-8381-700e2a4da83b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.686935 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.686860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0929386-81b6-467e-8381-700e2a4da83b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.686935 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.686925    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0929386-81b6-467e-8381-700e2a4da83b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.687046 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.686954    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0929386-81b6-467e-8381-700e2a4da83b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.687046 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.686994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chdxx\" (UniqueName: \"kubernetes.io/projected/b0929386-81b6-467e-8381-700e2a4da83b-kube-api-access-chdxx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.687137 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.687046    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0929386-81b6-467e-8381-700e2a4da83b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.687137 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.687077    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0929386-81b6-467e-8381-700e2a4da83b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.687249 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.687143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0929386-81b6-467e-8381-700e2a4da83b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.687249 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.687187    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0929386-81b6-467e-8381-700e2a4da83b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.788225 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.788187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0929386-81b6-467e-8381-700e2a4da83b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.788329 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.788233    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0929386-81b6-467e-8381-700e2a4da83b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.788329 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.788259    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0929386-81b6-467e-8381-700e2a4da83b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.788329 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.788287    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0929386-81b6-467e-8381-700e2a4da83b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.788329 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.788310    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0929386-81b6-467e-8381-700e2a4da83b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.788521 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.788353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0929386-81b6-467e-8381-700e2a4da83b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.788521 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.788388    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0929386-81b6-467e-8381-700e2a4da83b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.788521 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.788416    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0929386-81b6-467e-8381-700e2a4da83b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.788679 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.788650    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0929386-81b6-467e-8381-700e2a4da83b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.788732 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.788681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chdxx\" (UniqueName: \"kubernetes.io/projected/b0929386-81b6-467e-8381-700e2a4da83b-kube-api-access-chdxx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.788732 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.788714    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0929386-81b6-467e-8381-700e2a4da83b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.788821 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.788801    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0929386-81b6-467e-8381-700e2a4da83b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.788968 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.788948    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0929386-81b6-467e-8381-700e2a4da83b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.789033 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.789008    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0929386-81b6-467e-8381-700e2a4da83b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.790836 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.790813    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0929386-81b6-467e-8381-700e2a4da83b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.790914 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.790892    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0929386-81b6-467e-8381-700e2a4da83b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.795776 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.795751    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0929386-81b6-467e-8381-700e2a4da83b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.795920 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.795902    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chdxx\" (UniqueName: \"kubernetes.io/projected/b0929386-81b6-467e-8381-700e2a4da83b-kube-api-access-chdxx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4xx67\" (UID: \"b0929386-81b6-467e-8381-700e2a4da83b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:22.828769 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:22.828749    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:23.101722 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:23.101648    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"]
Sep 19 15:24:23.104740 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:24:23.104711    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0929386_81b6_467e_8381_700e2a4da83b.slice/crio-6b466849d1e0714cd1554596dc4e4ca2e593e575e22297e1dbc41e00901a2955 WatchSource:0}: Error finding container 6b466849d1e0714cd1554596dc4e4ca2e593e575e22297e1dbc41e00901a2955: Status 404 returned error can't find the container with id 6b466849d1e0714cd1554596dc4e4ca2e593e575e22297e1dbc41e00901a2955
Sep 19 15:24:23.106890 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:23.106858    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:24:23.106980 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:23.106926    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:24:23.106980 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:23.106956    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:24:23.334217 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:23.334163    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67" event={"ID":"b0929386-81b6-467e-8381-700e2a4da83b","Type":"ContainerStarted","Data":"2e0fbb80f6efeaa42a1dd7383aecaa718b3e898efa0fc3445d0757c80238aa76"}
Sep 19 15:24:23.334394 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:23.334247    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67" event={"ID":"b0929386-81b6-467e-8381-700e2a4da83b","Type":"ContainerStarted","Data":"6b466849d1e0714cd1554596dc4e4ca2e593e575e22297e1dbc41e00901a2955"}
Sep 19 15:24:23.353855 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:23.353758    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67" podStartSLOduration=1.3537397119999999 podStartE2EDuration="1.353739712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:24:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:24:23.351166483 +0000 UTC m=+726.514581525" watchObservedRunningTime="2026-09-19 15:24:23.353739712 +0000 UTC m=+726.517154757"
Sep 19 15:24:23.829807 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:23.829780    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:24.704491 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:24.704455    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:24.755757 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:24.755729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:24.833777 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:24.833748    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:25.344420 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:25.344385    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:25.345290 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:25.345271    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:24:36.162658 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:36.162624    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:37.234535 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:37.234505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:37.346966 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:37.346924    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:37.444310 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:37.444254    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:37.698139 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:37.698109    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:24:37.701656 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:37.701639    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-6m25c"
Sep 19 15:24:37.703709 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:37.703691    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 19 15:24:37.703808 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:37.703785    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-x2x89\""
Sep 19 15:24:37.708272 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:37.708251    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:24:37.731394 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:37.731370    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:24:37.808740 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:37.808712    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4b75dd2-61ed-4f17-a74e-e6d7df4faa89-config-file\") pod \"limitador-limitador-84994f7ffc-6m25c\" (UID: \"b4b75dd2-61ed-4f17-a74e-e6d7df4faa89\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6m25c"
Sep 19 15:24:37.808847 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:37.808748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzkv8\" (UniqueName: \"kubernetes.io/projected/b4b75dd2-61ed-4f17-a74e-e6d7df4faa89-kube-api-access-nzkv8\") pod \"limitador-limitador-84994f7ffc-6m25c\" (UID: \"b4b75dd2-61ed-4f17-a74e-e6d7df4faa89\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6m25c"
Sep 19 15:24:37.909602 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:37.909577    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4b75dd2-61ed-4f17-a74e-e6d7df4faa89-config-file\") pod \"limitador-limitador-84994f7ffc-6m25c\" (UID: \"b4b75dd2-61ed-4f17-a74e-e6d7df4faa89\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6m25c"
Sep 19 15:24:37.909705 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:37.909608    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzkv8\" (UniqueName: \"kubernetes.io/projected/b4b75dd2-61ed-4f17-a74e-e6d7df4faa89-kube-api-access-nzkv8\") pod \"limitador-limitador-84994f7ffc-6m25c\" (UID: \"b4b75dd2-61ed-4f17-a74e-e6d7df4faa89\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6m25c"
Sep 19 15:24:37.910153 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:37.910137    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4b75dd2-61ed-4f17-a74e-e6d7df4faa89-config-file\") pod \"limitador-limitador-84994f7ffc-6m25c\" (UID: \"b4b75dd2-61ed-4f17-a74e-e6d7df4faa89\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6m25c"
Sep 19 15:24:37.917743 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:37.917720    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzkv8\" (UniqueName: \"kubernetes.io/projected/b4b75dd2-61ed-4f17-a74e-e6d7df4faa89-kube-api-access-nzkv8\") pod \"limitador-limitador-84994f7ffc-6m25c\" (UID: \"b4b75dd2-61ed-4f17-a74e-e6d7df4faa89\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6m25c"
Sep 19 15:24:38.014753 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:38.014686    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-6m25c"
Sep 19 15:24:38.045636 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:38.045612    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:38.146361 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:38.146335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:38.282401 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:38.282379    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:24:38.284569 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:24:38.284542    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b75dd2_61ed_4f17_a74e_e6d7df4faa89.slice/crio-aff6f27e6fb49f8dcf28eb41a1d880378fc23b50c8dd3f8b65f26fae01bb7240 WatchSource:0}: Error finding container aff6f27e6fb49f8dcf28eb41a1d880378fc23b50c8dd3f8b65f26fae01bb7240: Status 404 returned error can't find the container with id aff6f27e6fb49f8dcf28eb41a1d880378fc23b50c8dd3f8b65f26fae01bb7240
Sep 19 15:24:38.404574 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:38.404539    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-6m25c" event={"ID":"b4b75dd2-61ed-4f17-a74e-e6d7df4faa89","Type":"ContainerStarted","Data":"aff6f27e6fb49f8dcf28eb41a1d880378fc23b50c8dd3f8b65f26fae01bb7240"}
Sep 19 15:24:40.414170 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:40.414135    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-6m25c" event={"ID":"b4b75dd2-61ed-4f17-a74e-e6d7df4faa89","Type":"ContainerStarted","Data":"dfad25398efba2ea91277ce5c20c38c2e02de3b9c0accadd004141f641cbdbcf"}
Sep 19 15:24:40.414601 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:40.414217    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-6m25c"
Sep 19 15:24:40.429442 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:40.429395    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-6m25c" podStartSLOduration=2.335278493 podStartE2EDuration="3.429380353s" totalImagesPullingTime="1.09410186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:24:40.42779423 +0000 UTC m=+743.591209272" watchObservedRunningTime="2026-09-19 15:24:40.429380353 +0000 UTC m=+743.592795393"
Sep 19 15:24:40.984125 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:40.984097    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:51.419168 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:51.419132    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-6m25c"
Sep 19 15:24:55.714254 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:55.714222    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:55.815303 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:55.815264    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:24:56.175713 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:24:56.175687    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:08.111679 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:08.111643    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:08.659645 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:08.659605    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:14.462018 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:14.461985    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:14.530951 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:14.530899    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:14.583510 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:14.583481    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:14.631428 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:14.631382    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:14.993545 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:14.993502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:18.440861 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:18.440824    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:18.540605 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:18.540569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:49.866951 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:49.866850    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:49.965267 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:49.965232    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:51.157079 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:51.157044    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:51.264665 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:51.264638    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:51.366632 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:51.366602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:51.468528 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:51.468441    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:51.563993 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:51.563965    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:51.956158 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:51.956125    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:52.051455 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:52.051424    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:25:52.173630 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:52.173597    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:25:59.569656 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:25:59.569621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:26:01.820598 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:01.820568    2562 generic.go:356] "Generic (PLEG): container finished" podID="b0929386-81b6-467e-8381-700e2a4da83b" containerID="2e0fbb80f6efeaa42a1dd7383aecaa718b3e898efa0fc3445d0757c80238aa76" exitCode=0
Sep 19 15:26:01.821018 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:01.820611    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67" event={"ID":"b0929386-81b6-467e-8381-700e2a4da83b","Type":"ContainerDied","Data":"2e0fbb80f6efeaa42a1dd7383aecaa718b3e898efa0fc3445d0757c80238aa76"}
Sep 19 15:26:01.821018 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:01.820967    2562 scope.go:117] "RemoveContainer" containerID="2e0fbb80f6efeaa42a1dd7383aecaa718b3e898efa0fc3445d0757c80238aa76"
Sep 19 15:26:01.821926 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:01.821900    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:26:01.821987 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:01.821973    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:26:01.822029 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:01.822009    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:26:02.061115 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:02.061075    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:26:02.161167 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:02.161018    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:26:02.827315 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:02.827279    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67" event={"ID":"b0929386-81b6-467e-8381-700e2a4da83b","Type":"ContainerStarted","Data":"1e5ecac22add43de3fd2d6a13481aa925cca263eb711dffda7d4f5460d11ab60"}
Sep 19 15:26:02.829807 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:02.829790    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:26:02.829984 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:02.829963    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4xx67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 19 15:26:02.830035 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:02.830010    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67" podUID="b0929386-81b6-467e-8381-700e2a4da83b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 19 15:26:03.829552 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:03.829517    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4xx67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 19 15:26:03.829997 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:03.829577    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67" podUID="b0929386-81b6-467e-8381-700e2a4da83b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 19 15:26:04.829323 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:04.829289    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4xx67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 19 15:26:04.829507 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:04.829346    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67" podUID="b0929386-81b6-467e-8381-700e2a4da83b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 19 15:26:05.829839 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:05.829808    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4xx67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 19 15:26:05.830244 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:05.829858    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67" podUID="b0929386-81b6-467e-8381-700e2a4da83b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 19 15:26:06.829903 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:06.829869    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4xx67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 19 15:26:06.830291 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:06.829928    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67" podUID="b0929386-81b6-467e-8381-700e2a4da83b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 19 15:26:07.833102 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:07.833074    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:26:07.833484 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:07.833457    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:26:07.834004 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:07.833986    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67"
Sep 19 15:26:33.619260 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.619219    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"]
Sep 19 15:26:33.622340 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.622319    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.625328 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.625306    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 19 15:26:33.625477 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.625321    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mqcwz\""
Sep 19 15:26:33.625553 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.625400    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 19 15:26:33.625609 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.625424    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 19 15:26:33.630476 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.630449    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"]
Sep 19 15:26:33.647115 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.647090    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:26:33.689373 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.689347    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ad2c103-c6f8-45d3-9694-c7d33661ae99-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.689472 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.689390    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ad2c103-c6f8-45d3-9694-c7d33661ae99-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.689472 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.689456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ad2c103-c6f8-45d3-9694-c7d33661ae99-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.689577 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.689500    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ad2c103-c6f8-45d3-9694-c7d33661ae99-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.689577 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.689536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf2ln\" (UniqueName: \"kubernetes.io/projected/8ad2c103-c6f8-45d3-9694-c7d33661ae99-kube-api-access-gf2ln\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.689658 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.689614    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ad2c103-c6f8-45d3-9694-c7d33661ae99-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.790403 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.790377    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ad2c103-c6f8-45d3-9694-c7d33661ae99-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.790506 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.790417    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ad2c103-c6f8-45d3-9694-c7d33661ae99-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.790506 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.790440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ad2c103-c6f8-45d3-9694-c7d33661ae99-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.790506 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.790472    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf2ln\" (UniqueName: \"kubernetes.io/projected/8ad2c103-c6f8-45d3-9694-c7d33661ae99-kube-api-access-gf2ln\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.790655 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.790525    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ad2c103-c6f8-45d3-9694-c7d33661ae99-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.790655 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.790551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ad2c103-c6f8-45d3-9694-c7d33661ae99-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.790845 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.790820    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ad2c103-c6f8-45d3-9694-c7d33661ae99-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.790902 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.790875    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ad2c103-c6f8-45d3-9694-c7d33661ae99-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.790940 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.790912    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ad2c103-c6f8-45d3-9694-c7d33661ae99-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.792965 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.792942    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ad2c103-c6f8-45d3-9694-c7d33661ae99-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.793245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.793225    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ad2c103-c6f8-45d3-9694-c7d33661ae99-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.798951 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.798929    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf2ln\" (UniqueName: \"kubernetes.io/projected/8ad2c103-c6f8-45d3-9694-c7d33661ae99-kube-api-access-gf2ln\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h\" (UID: \"8ad2c103-c6f8-45d3-9694-c7d33661ae99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:33.935539 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:33.935469    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:34.056301 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:34.056264    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:26:34.203857 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:34.203834    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"]
Sep 19 15:26:34.205740 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:26:34.205712    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad2c103_c6f8_45d3_9694_c7d33661ae99.slice/crio-ae0ba6ccb508d15e74fa3ed37096f8d36f586dea8f3e883473589fb6cfecb093 WatchSource:0}: Error finding container ae0ba6ccb508d15e74fa3ed37096f8d36f586dea8f3e883473589fb6cfecb093: Status 404 returned error can't find the container with id ae0ba6ccb508d15e74fa3ed37096f8d36f586dea8f3e883473589fb6cfecb093
Sep 19 15:26:34.983143 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:34.983108    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h" event={"ID":"8ad2c103-c6f8-45d3-9694-c7d33661ae99","Type":"ContainerStarted","Data":"ae0ba6ccb508d15e74fa3ed37096f8d36f586dea8f3e883473589fb6cfecb093"}
Sep 19 15:26:35.989634 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:35.989596    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h" event={"ID":"8ad2c103-c6f8-45d3-9694-c7d33661ae99","Type":"ContainerStarted","Data":"20a84cf685efe0708f79015e58202b9b42b02f0021627dd69de905bc78cf467e"}
Sep 19 15:26:36.007188 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:36.007144    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h" podStartSLOduration=1.865004393 podStartE2EDuration="3.007130229s" totalImagesPullingTime="1.142125836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:26:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:26:36.006012679 +0000 UTC m=+859.169427728" watchObservedRunningTime="2026-09-19 15:26:36.007130229 +0000 UTC m=+859.170545269"
Sep 19 15:26:43.935805 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:43.935762    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:43.936274 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:43.935832    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:43.948337 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:43.948308    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:44.042518 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:44.042488    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h"
Sep 19 15:26:44.063582 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:44.063522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:26:44.731148 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:44.731116    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:26:53.332464 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.332433    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"]
Sep 19 15:26:53.336042 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.336020    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.338335 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.338317    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 19 15:26:53.346011 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.345992    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"]
Sep 19 15:26:53.356799 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.356773    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:26:53.455505 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.455475    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5bfbba7-0224-4e23-b50d-dc405b0573d4-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.455670 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.455510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5bfbba7-0224-4e23-b50d-dc405b0573d4-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.455670 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.455537    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5bfbba7-0224-4e23-b50d-dc405b0573d4-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.455773 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.455700    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnbss\" (UniqueName: \"kubernetes.io/projected/f5bfbba7-0224-4e23-b50d-dc405b0573d4-kube-api-access-bnbss\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.455900 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.455885    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5bfbba7-0224-4e23-b50d-dc405b0573d4-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.455963 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.455920    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5bfbba7-0224-4e23-b50d-dc405b0573d4-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.557024 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.556988    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnbss\" (UniqueName: \"kubernetes.io/projected/f5bfbba7-0224-4e23-b50d-dc405b0573d4-kube-api-access-bnbss\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.557254 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.557047    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5bfbba7-0224-4e23-b50d-dc405b0573d4-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.557254 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.557067    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5bfbba7-0224-4e23-b50d-dc405b0573d4-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.557254 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.557099    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5bfbba7-0224-4e23-b50d-dc405b0573d4-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.557254 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.557113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5bfbba7-0224-4e23-b50d-dc405b0573d4-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.557254 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.557130    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5bfbba7-0224-4e23-b50d-dc405b0573d4-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.557601 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.557581    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5bfbba7-0224-4e23-b50d-dc405b0573d4-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.557657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.557621    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5bfbba7-0224-4e23-b50d-dc405b0573d4-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.557693 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.557651    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5bfbba7-0224-4e23-b50d-dc405b0573d4-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.560229 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.560209    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5bfbba7-0224-4e23-b50d-dc405b0573d4-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.560454 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.560436    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5bfbba7-0224-4e23-b50d-dc405b0573d4-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.564172 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.564149    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnbss\" (UniqueName: \"kubernetes.io/projected/f5bfbba7-0224-4e23-b50d-dc405b0573d4-kube-api-access-bnbss\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h\" (UID: \"f5bfbba7-0224-4e23-b50d-dc405b0573d4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.647120 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.647042    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:26:53.916668 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:53.916647    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"]
Sep 19 15:26:53.918912 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:26:53.918889    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5bfbba7_0224_4e23_b50d_dc405b0573d4.slice/crio-79b2fe8c08c4b8b8c49315c7d9db716b874ff88270ec3e25976a25f9a59f123d WatchSource:0}: Error finding container 79b2fe8c08c4b8b8c49315c7d9db716b874ff88270ec3e25976a25f9a59f123d: Status 404 returned error can't find the container with id 79b2fe8c08c4b8b8c49315c7d9db716b874ff88270ec3e25976a25f9a59f123d
Sep 19 15:26:54.076427 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:54.076393    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h" event={"ID":"f5bfbba7-0224-4e23-b50d-dc405b0573d4","Type":"ContainerStarted","Data":"79b2fe8c08c4b8b8c49315c7d9db716b874ff88270ec3e25976a25f9a59f123d"}
Sep 19 15:26:54.340244 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:54.340214    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:26:55.083267 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:55.083237    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h" event={"ID":"f5bfbba7-0224-4e23-b50d-dc405b0573d4","Type":"ContainerStarted","Data":"64d15966b519917f1eb828d095c4a0456f3c89bf3205e1dc22efb26ab79e4f08"}
Sep 19 15:26:55.098050 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:26:55.097985    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h" podStartSLOduration=1.926734502 podStartE2EDuration="2.097965518s" totalImagesPullingTime="171.231016ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:26:55.097366174 +0000 UTC m=+878.260781214" watchObservedRunningTime="2026-09-19 15:26:55.097965518 +0000 UTC m=+878.261380561"
Sep 19 15:27:03.648168 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:03.648124    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:27:03.648745 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:03.648214    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:27:03.660424 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:03.660402    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:27:04.137122 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:04.137092    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h"
Sep 19 15:27:07.847124 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.847075    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"]
Sep 19 15:27:07.852139 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.852115    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.852778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.852758    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"]
Sep 19 15:27:07.854178 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.854157    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 19 15:27:07.860336 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.860316    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:27:07.875591 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.875571    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6699db00-e0f5-4585-9914-c4b63e210134-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.875684 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.875644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6699db00-e0f5-4585-9914-c4b63e210134-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.875684 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.875660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6699db00-e0f5-4585-9914-c4b63e210134-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.875786 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.875698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6699db00-e0f5-4585-9914-c4b63e210134-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.875786 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.875714    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6699db00-e0f5-4585-9914-c4b63e210134-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.875786 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.875733    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n4km\" (UniqueName: \"kubernetes.io/projected/6699db00-e0f5-4585-9914-c4b63e210134-kube-api-access-2n4km\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.977217 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.977165    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6699db00-e0f5-4585-9914-c4b63e210134-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.977320 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.977295    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6699db00-e0f5-4585-9914-c4b63e210134-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.977362 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.977323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6699db00-e0f5-4585-9914-c4b63e210134-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.977415 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.977366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6699db00-e0f5-4585-9914-c4b63e210134-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.977415 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.977395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6699db00-e0f5-4585-9914-c4b63e210134-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.977511 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.977424    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n4km\" (UniqueName: \"kubernetes.io/projected/6699db00-e0f5-4585-9914-c4b63e210134-kube-api-access-2n4km\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.977696 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.977674    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6699db00-e0f5-4585-9914-c4b63e210134-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.977785 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.977764    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6699db00-e0f5-4585-9914-c4b63e210134-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.977864 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.977838    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6699db00-e0f5-4585-9914-c4b63e210134-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.979626 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.979611    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6699db00-e0f5-4585-9914-c4b63e210134-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.979883 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.979868    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6699db00-e0f5-4585-9914-c4b63e210134-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:07.984347 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:07.984329    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n4km\" (UniqueName: \"kubernetes.io/projected/6699db00-e0f5-4585-9914-c4b63e210134-kube-api-access-2n4km\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pkthv\" (UID: \"6699db00-e0f5-4585-9914-c4b63e210134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:08.183504 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:08.183426    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:08.464374 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:08.464348    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"]
Sep 19 15:27:08.466305 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:27:08.466277    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6699db00_e0f5_4585_9914_c4b63e210134.slice/crio-fa3d7ad274916b26ad54222d1dd5af909cb9d943a7fa0e7d8c9088e0e3d6def7 WatchSource:0}: Error finding container fa3d7ad274916b26ad54222d1dd5af909cb9d943a7fa0e7d8c9088e0e3d6def7: Status 404 returned error can't find the container with id fa3d7ad274916b26ad54222d1dd5af909cb9d943a7fa0e7d8c9088e0e3d6def7
Sep 19 15:27:09.141056 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:09.141019    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:27:09.152627 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:09.152597    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv" event={"ID":"6699db00-e0f5-4585-9914-c4b63e210134","Type":"ContainerStarted","Data":"29a57cd30f7b61b6f26e3f20ef50ebcd02f7a226fbd2a083fb851c583274f54b"}
Sep 19 15:27:09.152772 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:09.152646    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv" event={"ID":"6699db00-e0f5-4585-9914-c4b63e210134","Type":"ContainerStarted","Data":"fa3d7ad274916b26ad54222d1dd5af909cb9d943a7fa0e7d8c9088e0e3d6def7"}
Sep 19 15:27:09.167912 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:09.167870    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv" podStartSLOduration=2.003074929 podStartE2EDuration="2.167856161s" totalImagesPullingTime="164.781232ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:27:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:27:09.166788533 +0000 UTC m=+892.330203573" watchObservedRunningTime="2026-09-19 15:27:09.167856161 +0000 UTC m=+892.331271202"
Sep 19 15:27:17.855063 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:17.855030    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:27:18.183991 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:18.183912    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:18.184148 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:18.184005    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:18.196454 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:18.196428    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:18.208416 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:18.208392    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pkthv"
Sep 19 15:27:19.335949 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:19.335914    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:27:25.253130 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:25.253095    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:27:27.043666 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:27.043631    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:27:33.841857 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:33.841823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:27:35.944508 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:27:35.944473    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:29:27.016440 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:29:27.016408    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:29:27.122258 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:29:27.122188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:29:35.870569 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:29:35.870534    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:29:35.976110 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:29:35.976081    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:29:46.583839 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:29:46.583803    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:29:46.682508 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:29:46.682478    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:29:50.846532 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:29:50.846496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:03.474792 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:03.474753    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:03.808646 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:03.808614    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:04.922076 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:04.922041    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:05.020365 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:05.020333    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:05.954547 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:05.954518    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:06.055106 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:06.055071    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:20.061095 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.061038    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:20.114031 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.113986    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:20.340052 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.339975    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"]
Sep 19 15:30:20.343530 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.343507    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.345610 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.345589    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-15949d-openshift-default-dockercfg-pcwjw\""
Sep 19 15:30:20.355737 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.355712    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"]
Sep 19 15:30:20.387349 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.387322    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:20.408115 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.408092    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"]
Sep 19 15:30:20.411560 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.411544    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.413580 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.413555    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-21d2a4-openshift-default-dockercfg-5pkff\""
Sep 19 15:30:20.423671 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.423642    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"]
Sep 19 15:30:20.466797 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.466773    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"]
Sep 19 15:30:20.468736 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.468711    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:20.470471 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.470454    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.472548 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.472531    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-33737b-openshift-default-dockercfg-rcclv\""
Sep 19 15:30:20.480860 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.480842    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"]
Sep 19 15:30:20.519241 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-workload-socket\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.519362 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519260    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da3da919-7d85-48ee-ac22-8e7e58619004-istio-podinfo\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.519362 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519309    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-istio-data\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.519362 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519349    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da3da919-7d85-48ee-ac22-8e7e58619004-istio-token\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.519473 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519382    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87gvp\" (UniqueName: \"kubernetes.io/projected/da3da919-7d85-48ee-ac22-8e7e58619004-kube-api-access-87gvp\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.519473 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519408    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gvxv\" (UniqueName: \"kubernetes.io/projected/30c89743-402c-4b86-ac4f-eb6c9b35994a-kube-api-access-9gvxv\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.519473 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519461    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-credential-socket\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.519594 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-credential-socket\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.519594 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519517    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-istio-envoy\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.519701 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-envoy\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.519701 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519667    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-workload-socket\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.519808 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519710    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-token\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.519808 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519746    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-workload-certs\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.519808 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519770    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da3da919-7d85-48ee-ac22-8e7e58619004-istiod-ca-cert\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.519808 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519799    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-workload-certs\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.519960 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-podinfo\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.519960 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-data\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.519960 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.519873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30c89743-402c-4b86-ac4f-eb6c9b35994a-istiod-ca-cert\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.530829 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.530800    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:20.621355 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.621292    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-credential-socket\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.621355 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.621331    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-podinfo\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.621501 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.621356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-istio-envoy\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.621501 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.621372    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istiod-ca-cert\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.621501 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.621430    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-workload-socket\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.621501 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.621474    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-envoy\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.621670 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.621525    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-workload-socket\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.621670 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.621564    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-token\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.621670 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.621600    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-workload-certs\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.621670 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.621625    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da3da919-7d85-48ee-ac22-8e7e58619004-istiod-ca-cert\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.621866 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.621670    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-workload-certs\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.621866 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.621693    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-credential-socket\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.621968 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.621917    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-workload-certs\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.622153 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622070    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-workload-certs\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.622439 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622413    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da3da919-7d85-48ee-ac22-8e7e58619004-istiod-ca-cert\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.622526 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622458    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-podinfo\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.622526 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622423    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-workload-socket\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.622526 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622503    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl9x9\" (UniqueName: \"kubernetes.io/projected/8fdb610f-a61d-42ef-ba98-544e4b0aed49-kube-api-access-zl9x9\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.622854 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622543    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-data\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.622854 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622569    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30c89743-402c-4b86-ac4f-eb6c9b35994a-istiod-ca-cert\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.622854 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622604    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-workload-socket\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.622854 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622642    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-data\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.622854 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da3da919-7d85-48ee-ac22-8e7e58619004-istio-podinfo\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.622854 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-istio-data\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.622854 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622733    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da3da919-7d85-48ee-ac22-8e7e58619004-istio-token\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.622854 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622764    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87gvp\" (UniqueName: \"kubernetes.io/projected/da3da919-7d85-48ee-ac22-8e7e58619004-kube-api-access-87gvp\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.622854 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622793    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-token\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.622854 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622814    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-data\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.622854 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-workload-certs\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.623490 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622871    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gvxv\" (UniqueName: \"kubernetes.io/projected/30c89743-402c-4b86-ac4f-eb6c9b35994a-kube-api-access-9gvxv\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.623490 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622922    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-credential-socket\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.623490 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622954    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-credential-socket\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.623490 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.622981    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-envoy\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.623490 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.623035    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-istio-data\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.623490 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.623231    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30c89743-402c-4b86-ac4f-eb6c9b35994a-istiod-ca-cert\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.623810 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.623584    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-credential-socket\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.623810 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.623737    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-workload-socket\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.624062 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.624032    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-istio-envoy\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.624168 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.624143    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-envoy\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.624811 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.624793    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-podinfo\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.625915 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.625895    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da3da919-7d85-48ee-ac22-8e7e58619004-istio-podinfo\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.628885 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.628863    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-token\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.630402 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.630376    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:20.631034 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.631008    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gvxv\" (UniqueName: \"kubernetes.io/projected/30c89743-402c-4b86-ac4f-eb6c9b35994a-kube-api-access-9gvxv\") pod \"e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") " pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.631034 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.631029    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da3da919-7d85-48ee-ac22-8e7e58619004-istio-token\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.631287 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.631270    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87gvp\" (UniqueName: \"kubernetes.io/projected/da3da919-7d85-48ee-ac22-8e7e58619004-kube-api-access-87gvp\") pod \"e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") " pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.655190 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.655169    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:20.685515 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.685490    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:20.727901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.723465    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:20.727901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.724260    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-token\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.727901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.724299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-workload-certs\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.727901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.724359    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-credential-socket\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.727901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.724389    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-envoy\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.727901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.724431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-podinfo\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.727901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.724460    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istiod-ca-cert\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.727901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.724487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-workload-socket\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.727901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.724939    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-credential-socket\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.727901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.725113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl9x9\" (UniqueName: \"kubernetes.io/projected/8fdb610f-a61d-42ef-ba98-544e4b0aed49-kube-api-access-zl9x9\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.727901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.725175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-data\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.727901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.725499    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-data\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.727901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.725721    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-workload-socket\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.727901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.726265    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-workload-certs\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.727901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.727215    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istiod-ca-cert\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.730998 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.730955    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-podinfo\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.734133 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.734091    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-envoy\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.743776 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.743748    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-token\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.743933 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.743910    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl9x9\" (UniqueName: \"kubernetes.io/projected/8fdb610f-a61d-42ef-ba98-544e4b0aed49-kube-api-access-zl9x9\") pod \"e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") " pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.781645 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.781602    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:20.935510 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.935485    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"]
Sep 19 15:30:20.937233 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:30:20.937206    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c89743_402c_4b86_ac4f_eb6c9b35994a.slice/crio-e2a2cf368e7b87f02ab701e98f183e12ea61e2cf8c8aa5f627a260786bfe2442 WatchSource:0}: Error finding container e2a2cf368e7b87f02ab701e98f183e12ea61e2cf8c8aa5f627a260786bfe2442: Status 404 returned error can't find the container with id e2a2cf368e7b87f02ab701e98f183e12ea61e2cf8c8aa5f627a260786bfe2442
Sep 19 15:30:20.939444 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.939413    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:20.939526 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.939474    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:20.939526 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.939500    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:20.989849 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:20.989830    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:21.011582 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.011562    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"]
Sep 19 15:30:21.013323 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:30:21.013297    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda3da919_7d85_48ee_ac22_8e7e58619004.slice/crio-1af1b55ecb09e5c26392613e666c455ecc1cfa3c206c1969f69f5597fe1b66d0 WatchSource:0}: Error finding container 1af1b55ecb09e5c26392613e666c455ecc1cfa3c206c1969f69f5597fe1b66d0: Status 404 returned error can't find the container with id 1af1b55ecb09e5c26392613e666c455ecc1cfa3c206c1969f69f5597fe1b66d0
Sep 19 15:30:21.016117 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.016082    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:21.016230 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.016151    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:21.016230 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.016189    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:21.062488 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.062072    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"]
Sep 19 15:30:21.066925 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:30:21.066873    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fdb610f_a61d_42ef_ba98_544e4b0aed49.slice/crio-4995447d593196e9f3bea4e3a9f2f30f2685c73712a59e7d356a3b0dd318e5ce WatchSource:0}: Error finding container 4995447d593196e9f3bea4e3a9f2f30f2685c73712a59e7d356a3b0dd318e5ce: Status 404 returned error can't find the container with id 4995447d593196e9f3bea4e3a9f2f30f2685c73712a59e7d356a3b0dd318e5ce
Sep 19 15:30:21.068820 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.068785    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:21.068919 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.068847    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:21.068919 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.068874    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:21.118789 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.118750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7" event={"ID":"30c89743-402c-4b86-ac4f-eb6c9b35994a","Type":"ContainerStarted","Data":"c1e4a90f51170529d90b5b7455666ddaacf158970c67913a57fd27a9adb3849e"}
Sep 19 15:30:21.118915 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.118827    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7" event={"ID":"30c89743-402c-4b86-ac4f-eb6c9b35994a","Type":"ContainerStarted","Data":"e2a2cf368e7b87f02ab701e98f183e12ea61e2cf8c8aa5f627a260786bfe2442"}
Sep 19 15:30:21.120797 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.120775    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf" event={"ID":"8fdb610f-a61d-42ef-ba98-544e4b0aed49","Type":"ContainerStarted","Data":"4995447d593196e9f3bea4e3a9f2f30f2685c73712a59e7d356a3b0dd318e5ce"}
Sep 19 15:30:21.123054 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.122982    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q" event={"ID":"da3da919-7d85-48ee-ac22-8e7e58619004","Type":"ContainerStarted","Data":"82ed3898f43a2e850c794c25ac5dd52430092361779431bcad232581e25613ef"}
Sep 19 15:30:21.123054 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.123027    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q" event={"ID":"da3da919-7d85-48ee-ac22-8e7e58619004","Type":"ContainerStarted","Data":"1af1b55ecb09e5c26392613e666c455ecc1cfa3c206c1969f69f5597fe1b66d0"}
Sep 19 15:30:21.139618 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.139216    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7" podStartSLOduration=1.139178254 podStartE2EDuration="1.139178254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:30:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:30:21.135184602 +0000 UTC m=+1084.298599644" watchObservedRunningTime="2026-09-19 15:30:21.139178254 +0000 UTC m=+1084.302593298"
Sep 19 15:30:21.152741 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.152693    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q" podStartSLOduration=1.152680403 podStartE2EDuration="1.152680403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:30:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:30:21.151292449 +0000 UTC m=+1084.314707513" watchObservedRunningTime="2026-09-19 15:30:21.152680403 +0000 UTC m=+1084.316095443"
Sep 19 15:30:21.386314 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.386282    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:21.490211 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.490171    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:21.655579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.655507    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:21.660710 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.660686    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:21.724663 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.724637    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:21.846342 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:21.846310    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:22.130004 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:22.129942    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf" event={"ID":"8fdb610f-a61d-42ef-ba98-544e4b0aed49","Type":"ContainerStarted","Data":"7181f9d16e71516d965936343274057d58d137789df061faab9b03ba97c3679a"}
Sep 19 15:30:22.130530 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:22.130512    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:22.131103 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:22.131088    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:22.148979 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:22.148935    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf" podStartSLOduration=2.148921875 podStartE2EDuration="2.148921875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:30:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:30:22.146636149 +0000 UTC m=+1085.310051190" watchObservedRunningTime="2026-09-19 15:30:22.148921875 +0000 UTC m=+1085.312336915"
Sep 19 15:30:22.733390 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:22.733361    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:22.782776 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:22.782744    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:22.787715 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:22.787693    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:23.080775 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:23.080743    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:23.135548 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:23.135517    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:23.135976 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:23.135564    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:23.136453 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:23.136433    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:23.136545 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:23.136482    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:23.160991 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:23.160963    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:23.252889 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:23.252863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:23.338795 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:23.338712    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:24.130632 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:24.130599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:24.244042 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:24.244013    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:24.484630 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:24.484543    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:24.534633 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:24.534607    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:24.900730 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:24.900696    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:25.044410 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:25.044383    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:25.145393 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:25.145360    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:25.568999 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:25.568973    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:25.652781 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:25.652743    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:25.976345 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:25.976268    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:26.128535 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:26.128502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:26.222247 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:26.222215    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:26.681532 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:26.681506    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:26.737808 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:26.737769    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:26.988288 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:26.988187    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:27.127455 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:27.127420    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:27.221633 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:27.221605    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:27.558438 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:27.558408    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:28.017232 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.017134    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9301-eaa84f"]
Sep 19 15:30:28.023129 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.023104    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9301-eaa84f"
Sep 19 15:30:28.025765 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.025741    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hj4r7\""
Sep 19 15:30:28.027002 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.026980    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9301-eaa84f"]
Sep 19 15:30:28.092176 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.092149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfcqj\" (UniqueName: \"kubernetes.io/projected/03b58baf-5a15-466d-b0db-693ed9ce85d2-kube-api-access-cfcqj\") pod \"test-curl-9301-eaa84f\" (UID: \"03b58baf-5a15-466d-b0db-693ed9ce85d2\") " pod="opendatahub/test-curl-9301-eaa84f"
Sep 19 15:30:28.192805 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.192778    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfcqj\" (UniqueName: \"kubernetes.io/projected/03b58baf-5a15-466d-b0db-693ed9ce85d2-kube-api-access-cfcqj\") pod \"test-curl-9301-eaa84f\" (UID: \"03b58baf-5a15-466d-b0db-693ed9ce85d2\") " pod="opendatahub/test-curl-9301-eaa84f"
Sep 19 15:30:28.199864 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.199833    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfcqj\" (UniqueName: \"kubernetes.io/projected/03b58baf-5a15-466d-b0db-693ed9ce85d2-kube-api-access-cfcqj\") pod \"test-curl-9301-eaa84f\" (UID: \"03b58baf-5a15-466d-b0db-693ed9ce85d2\") " pod="opendatahub/test-curl-9301-eaa84f"
Sep 19 15:30:28.302898 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.302873    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:28.336818 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.336794    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9301-eaa84f"
Sep 19 15:30:28.405380 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.405323    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:28.524175 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.524144    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:28.606230 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.606207    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9301-eaa84f"]
Sep 19 15:30:28.608774 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:30:28.608748    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03b58baf_5a15_466d_b0db_693ed9ce85d2.slice/crio-72ad09ee49e9ded3f928f7a6c65a748d6becadc61638a28ead66346c9756fb0d WatchSource:0}: Error finding container 72ad09ee49e9ded3f928f7a6c65a748d6becadc61638a28ead66346c9756fb0d: Status 404 returned error can't find the container with id 72ad09ee49e9ded3f928f7a6c65a748d6becadc61638a28ead66346c9756fb0d
Sep 19 15:30:28.610709 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.610689    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 15:30:28.770621 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.770587    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"]
Sep 19 15:30:28.776218 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.776175    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.778320 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.778294    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e86b6784-openshift-default-dockercfg-tk4mk\""
Sep 19 15:30:28.786994 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.786970    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"]
Sep 19 15:30:28.798291 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.798262    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0bfabdf-0878-4f05-aa65-764af7a03526-istiod-ca-cert\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.798397 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.798297    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-workload-socket\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.798397 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.798314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-token\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.798397 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.798362    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-workload-certs\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.798397 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.798385    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-envoy\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.798634 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.798421    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-podinfo\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.798634 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.798469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-credential-socket\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.798634 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.798497    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n5vq\" (UniqueName: \"kubernetes.io/projected/d0bfabdf-0878-4f05-aa65-764af7a03526-kube-api-access-4n5vq\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.798634 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.798518    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-data\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.803738 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.803708    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:28.899635 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.899532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0bfabdf-0878-4f05-aa65-764af7a03526-istiod-ca-cert\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.899635 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.899595    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-workload-socket\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.899635 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.899626    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-token\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.899911 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.899664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-workload-certs\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.899911 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.899709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-envoy\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.899911 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.899735    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-podinfo\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.899911 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.899792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-credential-socket\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.899911 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.899835    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n5vq\" (UniqueName: \"kubernetes.io/projected/d0bfabdf-0878-4f05-aa65-764af7a03526-kube-api-access-4n5vq\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.899911 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.899869    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-data\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.900237 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.900019    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-workload-socket\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.900303 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.900271    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-data\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.900359 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.900332    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0bfabdf-0878-4f05-aa65-764af7a03526-istiod-ca-cert\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.900687 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.900650    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-workload-certs\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.900976 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.900887    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-credential-socket\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.902601 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.902579    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-envoy\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.902898 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.902882    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-podinfo\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.907408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.907387    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n5vq\" (UniqueName: \"kubernetes.io/projected/d0bfabdf-0878-4f05-aa65-764af7a03526-kube-api-access-4n5vq\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:28.907511 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:28.907436    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-token\") pod \"e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") " pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:29.072500 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:29.072469    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:29.090646 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:29.090618    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:29.170976 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:29.170880    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9301-eaa84f" event={"ID":"03b58baf-5a15-466d-b0db-693ed9ce85d2","Type":"ContainerStarted","Data":"72ad09ee49e9ded3f928f7a6c65a748d6becadc61638a28ead66346c9756fb0d"}
Sep 19 15:30:29.174386 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:29.174359    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:29.381475 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:29.381446    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"]
Sep 19 15:30:29.383500 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:30:29.383473    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0bfabdf_0878_4f05_aa65_764af7a03526.slice/crio-9a8ca30ea41f2ffc8b66fa0013eac653971863c85b78122b877caf8f1fbe5f88 WatchSource:0}: Error finding container 9a8ca30ea41f2ffc8b66fa0013eac653971863c85b78122b877caf8f1fbe5f88: Status 404 returned error can't find the container with id 9a8ca30ea41f2ffc8b66fa0013eac653971863c85b78122b877caf8f1fbe5f88
Sep 19 15:30:29.385682 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:29.385656    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:29.385753 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:29.385713    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:29.385753 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:29.385741    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:29.537962 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:29.537923    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:30:29.960067 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:29.960033    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:30.177778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:30.177739    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr" event={"ID":"d0bfabdf-0878-4f05-aa65-764af7a03526","Type":"ContainerStarted","Data":"d9fd721f8ba14d42c67b5bdf19c65be5f2c0ee858eb42f5ececafa7baeb2c141"}
Sep 19 15:30:30.178268 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:30.177809    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr" event={"ID":"d0bfabdf-0878-4f05-aa65-764af7a03526","Type":"ContainerStarted","Data":"9a8ca30ea41f2ffc8b66fa0013eac653971863c85b78122b877caf8f1fbe5f88"}
Sep 19 15:30:30.179413 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:30.179390    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9301-eaa84f" event={"ID":"03b58baf-5a15-466d-b0db-693ed9ce85d2","Type":"ContainerStarted","Data":"628bb93af9755ccaf564b6241d73aa51cc84f30eedd7d7c5e9e22caabdf2daf2"}
Sep 19 15:30:30.197503 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:30.197458    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr" podStartSLOduration=2.197443297 podStartE2EDuration="2.197443297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:30:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:30:30.196491481 +0000 UTC m=+1093.359906520" watchObservedRunningTime="2026-09-19 15:30:30.197443297 +0000 UTC m=+1093.360858337"
Sep 19 15:30:30.210276 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:30.210181    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-9301-eaa84f" podStartSLOduration=1.709863456 podStartE2EDuration="2.210168391s" totalImagesPullingTime="500.304935ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:30:30.208241582 +0000 UTC m=+1093.371656619" watchObservedRunningTime="2026-09-19 15:30:30.210168391 +0000 UTC m=+1093.373583432"
Sep 19 15:30:30.676099 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:30.676053    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:30.792583 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:30.792543    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9301-eaa84f"]
Sep 19 15:30:30.795680 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:30.795649    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9301-eaa84f"]
Sep 19 15:30:31.093364 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:31.093326    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:31.102698 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:31.102649    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:31.184950 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:30:31.184916    2562 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-9301-eaa84f" container="test-curl-9301-eaa84f"
Sep 19 15:30:31.185350 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:31.185002    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:31.185833 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:31.185817    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:31.254119 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:31.254083    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:31.486497 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:31.486404    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:31.632765 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:31.632723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:31.724998 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:31.724958    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:32.193521 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:32.193479    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-9301-eaa84f" podUID="03b58baf-5a15-466d-b0db-693ed9ce85d2" containerName="test-curl-9301-eaa84f" containerID="cri-o://628bb93af9755ccaf564b6241d73aa51cc84f30eedd7d7c5e9e22caabdf2daf2" gracePeriod=2
Sep 19 15:30:32.363147 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:32.363119    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:32.963988 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:32.963963    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:33.852739 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:33.852705    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:34.626221 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:34.625281    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9301-eaa84f"
Sep 19 15:30:34.682306 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:34.682277    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfcqj\" (UniqueName: \"kubernetes.io/projected/03b58baf-5a15-466d-b0db-693ed9ce85d2-kube-api-access-cfcqj\") pod \"03b58baf-5a15-466d-b0db-693ed9ce85d2\" (UID: \"03b58baf-5a15-466d-b0db-693ed9ce85d2\") "
Sep 19 15:30:34.698416 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:34.698360    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03b58baf-5a15-466d-b0db-693ed9ce85d2-kube-api-access-cfcqj" (OuterVolumeSpecName: "kube-api-access-cfcqj") pod "03b58baf-5a15-466d-b0db-693ed9ce85d2" (UID: "03b58baf-5a15-466d-b0db-693ed9ce85d2"). InnerVolumeSpecName "kube-api-access-cfcqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:30:34.756658 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:34.756507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:34.784218 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:34.784078    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfcqj\" (UniqueName: \"kubernetes.io/projected/03b58baf-5a15-466d-b0db-693ed9ce85d2-kube-api-access-cfcqj\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:30:34.842279 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:34.839054    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:35.205775 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:35.205656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:35.245243 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:35.241738    2562 generic.go:356] "Generic (PLEG): container finished" podID="03b58baf-5a15-466d-b0db-693ed9ce85d2" containerID="628bb93af9755ccaf564b6241d73aa51cc84f30eedd7d7c5e9e22caabdf2daf2" exitCode=137
Sep 19 15:30:35.245243 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:35.241837    2562 scope.go:117] "RemoveContainer" containerID="628bb93af9755ccaf564b6241d73aa51cc84f30eedd7d7c5e9e22caabdf2daf2"
Sep 19 15:30:35.245243 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:35.241996    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9301-eaa84f"
Sep 19 15:30:35.264734 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:30:35.264689    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-9301-eaa84f\" is forbidden: User \"system:node:ip-10-0-132-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-152.ec2.internal' and this object" podUID="03b58baf-5a15-466d-b0db-693ed9ce85d2" pod="opendatahub/test-curl-9301-eaa84f"
Sep 19 15:30:35.283375 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:35.282901    2562 scope.go:117] "RemoveContainer" containerID="628bb93af9755ccaf564b6241d73aa51cc84f30eedd7d7c5e9e22caabdf2daf2"
Sep 19 15:30:35.283375 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:30:35.283259    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"628bb93af9755ccaf564b6241d73aa51cc84f30eedd7d7c5e9e22caabdf2daf2\": container with ID starting with 628bb93af9755ccaf564b6241d73aa51cc84f30eedd7d7c5e9e22caabdf2daf2 not found: ID does not exist" containerID="628bb93af9755ccaf564b6241d73aa51cc84f30eedd7d7c5e9e22caabdf2daf2"
Sep 19 15:30:35.283375 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:35.283302    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"628bb93af9755ccaf564b6241d73aa51cc84f30eedd7d7c5e9e22caabdf2daf2"} err="failed to get container status \"628bb93af9755ccaf564b6241d73aa51cc84f30eedd7d7c5e9e22caabdf2daf2\": rpc error: code = NotFound desc = could not find container \"628bb93af9755ccaf564b6241d73aa51cc84f30eedd7d7c5e9e22caabdf2daf2\": container with ID starting with 628bb93af9755ccaf564b6241d73aa51cc84f30eedd7d7c5e9e22caabdf2daf2 not found: ID does not exist"
Sep 19 15:30:35.302221 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:35.301916    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:35.357170 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:35.357138    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03b58baf-5a15-466d-b0db-693ed9ce85d2" path="/var/lib/kubelet/pods/03b58baf-5a15-466d-b0db-693ed9ce85d2/volumes"
Sep 19 15:30:35.666861 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:35.666829    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:36.272755 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:36.272727    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:36.782988 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:36.782893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:36.882249 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:36.882181    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:37.045400 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:37.045370    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:37.560798 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:37.560755    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:37.739500 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:37.739428    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:37.839991 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:37.839878    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:38.043426 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.043394    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:38.165777 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.165692    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:38.171421 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.171378    2562 patch_prober.go:28] interesting pod/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 19 15:30:38.171630 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.171444    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7" podUID="30c89743-402c-4b86-ac4f-eb6c9b35994a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 19 15:30:38.264509 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.264477    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:38.349676 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.349637    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"]
Sep 19 15:30:38.350360 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.350339    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03b58baf-5a15-466d-b0db-693ed9ce85d2" containerName="test-curl-9301-eaa84f"
Sep 19 15:30:38.350434 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.350363    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="03b58baf-5a15-466d-b0db-693ed9ce85d2" containerName="test-curl-9301-eaa84f"
Sep 19 15:30:38.350491 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.350453    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="03b58baf-5a15-466d-b0db-693ed9ce85d2" containerName="test-curl-9301-eaa84f"
Sep 19 15:30:38.355591 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.355566    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.358284 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.358259    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e93f57-openshift-default-dockercfg-bcv7s\""
Sep 19 15:30:38.395461 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.395431    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"]
Sep 19 15:30:38.400830 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.400709    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:38.441031 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.440991    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-workload-certs\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.441227 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.441058    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-data\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.441227 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.441132    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-workload-socket\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.441227 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.441154    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-podinfo\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.442145 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.441679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gmkw\" (UniqueName: \"kubernetes.io/projected/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-kube-api-access-7gmkw\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.442145 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.441733    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-credential-socket\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.442145 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.441774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-envoy\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.442145 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.441879    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-token\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.442145 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.441912    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istiod-ca-cert\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.500139 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.500093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:38.542809 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.542770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-token\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.542995 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.542824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istiod-ca-cert\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.542995 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.542893    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-workload-certs\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.542995 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.542928    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-data\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.542995 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.542965    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-workload-socket\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.542995 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.542993    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-podinfo\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.543301 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.543105    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gmkw\" (UniqueName: \"kubernetes.io/projected/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-kube-api-access-7gmkw\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.543301 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.543133    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-credential-socket\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.543301 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.543166    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-envoy\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.543644 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.543617    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-workload-socket\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.544317 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.544285    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istiod-ca-cert\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.545371 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.544534    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-workload-certs\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.545371 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.544754    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-data\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.547091 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.546486    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-credential-socket\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.547091 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.546678    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-envoy\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.548376 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.548349    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-podinfo\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.556772 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.556745    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-token\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.556896 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.556745    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gmkw\" (UniqueName: \"kubernetes.io/projected/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-kube-api-access-7gmkw\") pod \"e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") " pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.601891 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.601854    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:38.668182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.668150    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:38.704977 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.704906    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:38.966379 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.966341    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"]
Sep 19 15:30:38.969802 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:30:38.969774    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e6ef0d_cba0_4fe1_b9ce_3c4ec689a10b.slice/crio-267f14fbf5e7aa4a3acf4c86f22ec5bda9808926372dea2b5bec9b718292a35e WatchSource:0}: Error finding container 267f14fbf5e7aa4a3acf4c86f22ec5bda9808926372dea2b5bec9b718292a35e: Status 404 returned error can't find the container with id 267f14fbf5e7aa4a3acf4c86f22ec5bda9808926372dea2b5bec9b718292a35e
Sep 19 15:30:38.973151 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.973106    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:38.973305 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.973225    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:38.973305 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:38.973271    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:39.143630 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:39.143553    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:39.177412 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:39.177369    2562 patch_prober.go:28] interesting pod/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 19 15:30:39.177636 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:39.177435    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q" podUID="da3da919-7d85-48ee-ac22-8e7e58619004" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 19 15:30:39.242278 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:39.242134    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:39.274630 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:39.274463    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q" event={"ID":"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b","Type":"ContainerStarted","Data":"f9824a45b77e7bd88dcb0bea197d880f7f7394fec26884b3e2bf372d716cb604"}
Sep 19 15:30:39.274630 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:39.274527    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q" event={"ID":"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b","Type":"ContainerStarted","Data":"267f14fbf5e7aa4a3acf4c86f22ec5bda9808926372dea2b5bec9b718292a35e"}
Sep 19 15:30:39.298995 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:39.297540    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q" podStartSLOduration=1.29751985 podStartE2EDuration="1.29751985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:30:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:30:39.293929828 +0000 UTC m=+1102.457344868" watchObservedRunningTime="2026-09-19 15:30:39.29751985 +0000 UTC m=+1102.460934892"
Sep 19 15:30:39.342617 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:39.342525    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:39.669095 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:39.669055    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:39.894798 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:39.894762    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:40.491213 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:40.491161    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:40.675294 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:40.675267    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:41.198495 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:41.154501    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:42.650135 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:41.249981    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:42.650135 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:41.285656    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:42.650135 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:41.286503    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:30:42.650135 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:41.369588    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:42.650135 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:42.154335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:42.873894 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:42.873867    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:42.972954 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:42.972858    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:43.073039 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.073006    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:43.186478 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.186425    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:43.306778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.306738    2562 generic.go:356] "Generic (PLEG): container finished" podID="da3da919-7d85-48ee-ac22-8e7e58619004" containerID="82ed3898f43a2e850c794c25ac5dd52430092361779431bcad232581e25613ef" exitCode=0
Sep 19 15:30:43.306973 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.306831    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q" event={"ID":"da3da919-7d85-48ee-ac22-8e7e58619004","Type":"ContainerDied","Data":"82ed3898f43a2e850c794c25ac5dd52430092361779431bcad232581e25613ef"}
Sep 19 15:30:43.307393 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.307368    2562 scope.go:117] "RemoveContainer" containerID="82ed3898f43a2e850c794c25ac5dd52430092361779431bcad232581e25613ef"
Sep 19 15:30:43.309717 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.309673    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:43.309826 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.309772    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:43.309897 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.309822    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:43.312251 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.312226    2562 generic.go:356] "Generic (PLEG): container finished" podID="30c89743-402c-4b86-ac4f-eb6c9b35994a" containerID="c1e4a90f51170529d90b5b7455666ddaacf158970c67913a57fd27a9adb3849e" exitCode=0
Sep 19 15:30:43.312370 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.312351    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7" event={"ID":"30c89743-402c-4b86-ac4f-eb6c9b35994a","Type":"ContainerDied","Data":"c1e4a90f51170529d90b5b7455666ddaacf158970c67913a57fd27a9adb3849e"}
Sep 19 15:30:43.312795 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.312774    2562 scope.go:117] "RemoveContainer" containerID="c1e4a90f51170529d90b5b7455666ddaacf158970c67913a57fd27a9adb3849e"
Sep 19 15:30:43.317228 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.317152    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:43.317339 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.317264    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:43.317339 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.317315    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:43.324232 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.324007    2562 generic.go:356] "Generic (PLEG): container finished" podID="8fdb610f-a61d-42ef-ba98-544e4b0aed49" containerID="7181f9d16e71516d965936343274057d58d137789df061faab9b03ba97c3679a" exitCode=0
Sep 19 15:30:43.324685 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.324651    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf" event={"ID":"8fdb610f-a61d-42ef-ba98-544e4b0aed49","Type":"ContainerDied","Data":"7181f9d16e71516d965936343274057d58d137789df061faab9b03ba97c3679a"}
Sep 19 15:30:43.324989 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.324975    2562 scope.go:117] "RemoveContainer" containerID="7181f9d16e71516d965936343274057d58d137789df061faab9b03ba97c3679a"
Sep 19 15:30:43.325732 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.325333    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:43.326126 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.325879    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:43.326126 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.325940    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:43.326126 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.325980    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:43.427453 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.426313    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:43.528879 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.528849    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:43.604797 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.604619    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:43.877989 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:43.877892    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:44.336352 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:44.336312    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7" event={"ID":"30c89743-402c-4b86-ac4f-eb6c9b35994a","Type":"ContainerStarted","Data":"deb795e21a50139d371bd23af431577ae0907063e03440e934a53e017945358c"}
Sep 19 15:30:44.340446 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:44.340416    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf" event={"ID":"8fdb610f-a61d-42ef-ba98-544e4b0aed49","Type":"ContainerStarted","Data":"26f138eb4991a7c707618b70ab86423b1b4fbaa355cc777c11560cdc5ed80763"}
Sep 19 15:30:44.343499 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:44.343471    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q" event={"ID":"da3da919-7d85-48ee-ac22-8e7e58619004","Type":"ContainerStarted","Data":"49b095064e313ea996caa4bbee47f1d69a420c445f64dce28ef4351ef2f10013"}
Sep 19 15:30:44.651636 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:44.651474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:44.656559 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:44.656538    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:44.656934 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:44.656900    2562 patch_prober.go:28] interesting pod/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 19 15:30:44.657100 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:44.657079    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7" podUID="30c89743-402c-4b86-ac4f-eb6c9b35994a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 19 15:30:44.724391 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:44.724030    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:44.724814 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:44.724791    2562 patch_prober.go:28] interesting pod/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 19 15:30:44.724993 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:44.724971    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q" podUID="da3da919-7d85-48ee-ac22-8e7e58619004" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 19 15:30:44.782380 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:44.782336    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:44.782615 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:44.782587    2562 patch_prober.go:28] interesting pod/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 19 15:30:44.782816 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:44.782779    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf" podUID="8fdb610f-a61d-42ef-ba98-544e4b0aed49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 19 15:30:45.162644 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:45.162604    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:45.655677 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:45.655637    2562 patch_prober.go:28] interesting pod/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 19 15:30:45.656019 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:45.655979    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7" podUID="30c89743-402c-4b86-ac4f-eb6c9b35994a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 19 15:30:45.724224 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:45.724165    2562 patch_prober.go:28] interesting pod/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 19 15:30:45.724493 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:45.724463    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q" podUID="da3da919-7d85-48ee-ac22-8e7e58619004" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 19 15:30:45.794227 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:45.789687    2562 patch_prober.go:28] interesting pod/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 19 15:30:45.794227 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:45.789780    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf" podUID="8fdb610f-a61d-42ef-ba98-544e4b0aed49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 19 15:30:46.656389 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:46.656351    2562 patch_prober.go:28] interesting pod/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 19 15:30:46.656993 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:46.656963    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7" podUID="30c89743-402c-4b86-ac4f-eb6c9b35994a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 19 15:30:46.724747 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:46.724710    2562 patch_prober.go:28] interesting pod/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 19 15:30:46.725054 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:46.725026    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q" podUID="da3da919-7d85-48ee-ac22-8e7e58619004" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 19 15:30:46.782423 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:46.782384    2562 patch_prober.go:28] interesting pod/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 19 15:30:46.782720 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:46.782689    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf" podUID="8fdb610f-a61d-42ef-ba98-544e4b0aed49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 19 15:30:47.656559 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:47.656523    2562 patch_prober.go:28] interesting pod/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 19 15:30:47.657135 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:47.657103    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7" podUID="30c89743-402c-4b86-ac4f-eb6c9b35994a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 19 15:30:47.725026 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:47.724984    2562 patch_prober.go:28] interesting pod/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 19 15:30:47.725252 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:47.725051    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q" podUID="da3da919-7d85-48ee-ac22-8e7e58619004" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 19 15:30:47.782473 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:47.782433    2562 patch_prober.go:28] interesting pod/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 19 15:30:47.782672 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:47.782518    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf" podUID="8fdb610f-a61d-42ef-ba98-544e4b0aed49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 19 15:30:48.211616 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:48.211548    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:48.656944 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:48.656890    2562 patch_prober.go:28] interesting pod/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 19 15:30:48.657443 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:48.656966    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7" podUID="30c89743-402c-4b86-ac4f-eb6c9b35994a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 19 15:30:48.724916 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:48.724869    2562 patch_prober.go:28] interesting pod/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 19 15:30:48.725117 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:48.724940    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q" podUID="da3da919-7d85-48ee-ac22-8e7e58619004" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 19 15:30:48.782520 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:48.782480    2562 patch_prober.go:28] interesting pod/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 19 15:30:48.782693 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:48.782547    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf" podUID="8fdb610f-a61d-42ef-ba98-544e4b0aed49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 19 15:30:49.021854 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:49.021757    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:49.193288 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:49.193246    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:49.295298 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:49.295257    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:49.656150 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:49.656052    2562 patch_prober.go:28] interesting pod/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 19 15:30:49.656150 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:49.656120    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7" podUID="30c89743-402c-4b86-ac4f-eb6c9b35994a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 19 15:30:49.725166 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:49.725119    2562 patch_prober.go:28] interesting pod/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 19 15:30:49.725677 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:49.725214    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q" podUID="da3da919-7d85-48ee-ac22-8e7e58619004" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 19 15:30:49.782053 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:49.782018    2562 patch_prober.go:28] interesting pod/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 19 15:30:49.782265 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:49.782069    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf" podUID="8fdb610f-a61d-42ef-ba98-544e4b0aed49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 19 15:30:49.800220 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:49.800166    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:30:50.659964 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:50.659936    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:50.660269 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:50.660244    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:50.660928 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:50.660907    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:30:50.728350 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:50.728320    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:50.728748 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:50.728730    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:50.729320 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:50.729300    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:30:50.787651 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:50.787622    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:50.788108 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:50.787968    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:50.788735 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:50.788706    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:30:51.351224 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:51.351179    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:30:52.435599 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:52.435562    2562 generic.go:356] "Generic (PLEG): container finished" podID="d0bfabdf-0878-4f05-aa65-764af7a03526" containerID="d9fd721f8ba14d42c67b5bdf19c65be5f2c0ee858eb42f5ececafa7baeb2c141" exitCode=0
Sep 19 15:30:52.435991 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:52.435643    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr" event={"ID":"d0bfabdf-0878-4f05-aa65-764af7a03526","Type":"ContainerDied","Data":"d9fd721f8ba14d42c67b5bdf19c65be5f2c0ee858eb42f5ececafa7baeb2c141"}
Sep 19 15:30:52.436396 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:52.436381    2562 scope.go:117] "RemoveContainer" containerID="d9fd721f8ba14d42c67b5bdf19c65be5f2c0ee858eb42f5ececafa7baeb2c141"
Sep 19 15:30:52.437623 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:52.437597    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:52.437693 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:52.437664    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:52.437730 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:52.437697    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:30:53.443020 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:53.442987    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr" event={"ID":"d0bfabdf-0878-4f05-aa65-764af7a03526","Type":"ContainerStarted","Data":"208b542906aa89d72f3dbc5c5ac113a7832c89b3f2abcaae10a637a2574dacd7"}
Sep 19 15:30:54.091288 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:54.091251    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:30:54.091551 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:54.091521    2562 patch_prober.go:28] interesting pod/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 19 15:30:54.091635 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:54.091589    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr" podUID="d0bfabdf-0878-4f05-aa65-764af7a03526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 19 15:30:55.091020 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:55.090981    2562 patch_prober.go:28] interesting pod/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 19 15:30:55.091592 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:55.091559    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr" podUID="d0bfabdf-0878-4f05-aa65-764af7a03526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 19 15:30:56.091579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:56.091537    2562 patch_prober.go:28] interesting pod/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 19 15:30:56.092178 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:56.092145    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr" podUID="d0bfabdf-0878-4f05-aa65-764af7a03526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 19 15:30:57.091597 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:57.091559    2562 patch_prober.go:28] interesting pod/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 19 15:30:57.092157 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:57.092126    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr" podUID="d0bfabdf-0878-4f05-aa65-764af7a03526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 19 15:30:58.091093 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:58.091057    2562 patch_prober.go:28] interesting pod/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 19 15:30:58.091551 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:58.091518    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr" podUID="d0bfabdf-0878-4f05-aa65-764af7a03526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 19 15:30:59.091783 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:59.091334    2562 patch_prober.go:28] interesting pod/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 19 15:30:59.091783 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:59.091396    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr" podUID="d0bfabdf-0878-4f05-aa65-764af7a03526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 19 15:30:59.237862 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:30:59.237822    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:00.096094 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.096053    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:31:00.096555 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.096478    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:31:00.097186 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.097168    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:31:00.373232 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.373133    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:00.829876 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.829843    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"]
Sep 19 15:31:00.832478 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.832458    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.835646 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.835624    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-15949d\"/\"default-dockercfg-c4qvm\""
Sep 19 15:31:00.835779 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.835624    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-15949d\"/\"simulator-w0-15949d-kserve-self-signed-certs\""
Sep 19 15:31:00.835779 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.835627    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-15949d\"/\"kube-root-ca.crt\""
Sep 19 15:31:00.835779 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.835667    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-15949d\"/\"openshift-service-ca.crt\""
Sep 19 15:31:00.843383 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.843361    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"]
Sep 19 15:31:00.856721 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.856698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32cb6c46-413c-4a16-9671-4fa600a4aa7c-tls-certs\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.856838 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.856742    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-home\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.856838 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.856771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-dshm\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.856838 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.856803    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-model-cache\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.856838 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.856830    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x98sd\" (UniqueName: \"kubernetes.io/projected/32cb6c46-413c-4a16-9671-4fa600a4aa7c-kube-api-access-x98sd\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.857069 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.856972    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-tmp-dir\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.858992 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.858961    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:00.957972 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.957946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-model-cache\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.958076 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.957983    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x98sd\" (UniqueName: \"kubernetes.io/projected/32cb6c46-413c-4a16-9671-4fa600a4aa7c-kube-api-access-x98sd\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.958076 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.958052    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-tmp-dir\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.958167 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.958111    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32cb6c46-413c-4a16-9671-4fa600a4aa7c-tls-certs\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.958167 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.958160    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-home\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.958314 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.958190    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-dshm\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.958433 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.958415    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-model-cache\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.958517 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.958495    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-tmp-dir\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.958567 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.958513    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-home\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.960666 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.960630    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-dshm\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.960924 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.960904    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32cb6c46-413c-4a16-9671-4fa600a4aa7c-tls-certs\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:00.965036 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:00.965015    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x98sd\" (UniqueName: \"kubernetes.io/projected/32cb6c46-413c-4a16-9671-4fa600a4aa7c-kube-api-access-x98sd\") pod \"simulator-w0-15949d-kserve-849d8c8487-467zg\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") " pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:01.028273 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:01.028183    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:01.143513 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:01.143434    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:01.414736 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:01.414708    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"]
Sep 19 15:31:01.415841 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:31:01.415810    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32cb6c46_413c_4a16_9671_4fa600a4aa7c.slice/crio-f727d371621cef39f69d265cbe29a9108714cebc96e5097b5c68cd0f59b3b41c WatchSource:0}: Error finding container f727d371621cef39f69d265cbe29a9108714cebc96e5097b5c68cd0f59b3b41c: Status 404 returned error can't find the container with id f727d371621cef39f69d265cbe29a9108714cebc96e5097b5c68cd0f59b3b41c
Sep 19 15:31:01.502244 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:01.502181    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg" event={"ID":"32cb6c46-413c-4a16-9671-4fa600a4aa7c","Type":"ContainerStarted","Data":"111bd34e9aee0daa7acbc74d94e47c39efef4978a69299f74c6ec70fd9900b43"}
Sep 19 15:31:01.502636 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:01.502256    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg" event={"ID":"32cb6c46-413c-4a16-9671-4fa600a4aa7c","Type":"ContainerStarted","Data":"f727d371621cef39f69d265cbe29a9108714cebc96e5097b5c68cd0f59b3b41c"}
Sep 19 15:31:01.519464 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:01.519418    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg" podStartSLOduration=1.519403152 podStartE2EDuration="1.519403152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:31:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:31:01.517228144 +0000 UTC m=+1124.680643189" watchObservedRunningTime="2026-09-19 15:31:01.519403152 +0000 UTC m=+1124.682818191"
Sep 19 15:31:01.767371 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:01.767339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:02.509993 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:02.509961    2562 generic.go:356] "Generic (PLEG): container finished" podID="27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" containerID="f9824a45b77e7bd88dcb0bea197d880f7f7394fec26884b3e2bf372d716cb604" exitCode=0
Sep 19 15:31:02.510377 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:02.510037    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q" event={"ID":"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b","Type":"ContainerDied","Data":"f9824a45b77e7bd88dcb0bea197d880f7f7394fec26884b3e2bf372d716cb604"}
Sep 19 15:31:02.510526 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:02.510510    2562 scope.go:117] "RemoveContainer" containerID="f9824a45b77e7bd88dcb0bea197d880f7f7394fec26884b3e2bf372d716cb604"
Sep 19 15:31:02.511669 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:02.511639    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:31:02.511733 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:02.511707    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:31:02.511769 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:02.511736    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:31:02.566069 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:02.566047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:03.327476 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:03.327442    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:03.521189 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:03.521159    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q" event={"ID":"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b","Type":"ContainerStarted","Data":"ea10739a4ad1a81bbc61ca73c96b6f6d50cce68ee30ca156c43bbb908b1fabe8"}
Sep 19 15:31:03.669002 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:03.668924    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:31:03.669144 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:03.669059    2562 patch_prober.go:28] interesting pod/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 19 15:31:03.669144 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:03.669110    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q" podUID="27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 19 15:31:03.919859 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:03.919779    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:04.626117 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:04.624725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:04.668714 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:04.668681    2562 patch_prober.go:28] interesting pod/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 19 15:31:04.668879 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:04.668732    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q" podUID="27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 19 15:31:05.215541 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:05.215507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:05.669002 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:05.668968    2562 patch_prober.go:28] interesting pod/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 19 15:31:05.669411 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:05.669020    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q" podUID="27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 19 15:31:05.936793 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:05.936712    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:06.084729 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:06.084694    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:06.553487 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:06.553455    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:06.669295 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:06.669259    2562 patch_prober.go:28] interesting pod/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 19 15:31:06.669741 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:06.669317    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q" podUID="27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 19 15:31:06.866752 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:06.866672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:07.669153 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:07.669118    2562 patch_prober.go:28] interesting pod/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 19 15:31:07.669347 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:07.669169    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q" podUID="27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 19 15:31:08.672101 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:08.672069    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:31:08.672493 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:08.672452    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:31:08.673104 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:08.673085    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:31:10.246421 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:10.246340    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:31:11.144140 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:11.144101    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:11.144140 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:11.144146    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:11.157178 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:11.157153    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:11.576537 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:11.576497    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:31:13.032680 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:13.032650    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:13.547236 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:13.547179    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:13.611295 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:13.611266    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:13.668369 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:13.668337    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:13.727345 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:13.727318    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:13.846830 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:13.846743    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"]
Sep 19 15:31:13.847119 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:13.847013    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr" podUID="d0bfabdf-0878-4f05-aa65-764af7a03526" containerName="istio-proxy" containerID="cri-o://208b542906aa89d72f3dbc5c5ac113a7832c89b3f2abcaae10a637a2574dacd7" gracePeriod=30
Sep 19 15:31:13.868534 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:13.868503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:14.156885 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.156798    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:14.312171 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.312144    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:14.421387 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.421276    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:14.524997 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.524951    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:14.791770 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.791736    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"]
Sep 19 15:31:14.794821 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.794803    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:14.796999 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.796969    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-a95f496f-gw-openshift-default-dockercfg-7vkl6\""
Sep 19 15:31:14.810137 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.810110    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"]
Sep 19 15:31:14.816314 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.816287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:14.913131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.912458    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-workload-socket\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:14.913131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.912544    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-istio-envoy\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:14.913131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.912604    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-workload-certs\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:14.913131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.912684    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-istio-data\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:14.913131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.912728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65cefc77-da32-4b90-98df-97a0b6def37f-istio-token\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:14.913131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.912788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65cefc77-da32-4b90-98df-97a0b6def37f-istiod-ca-cert\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:14.913131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.912857    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65cefc77-da32-4b90-98df-97a0b6def37f-istio-podinfo\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:14.913131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.912892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-credential-socket\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:14.913131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.912959    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnnf9\" (UniqueName: \"kubernetes.io/projected/65cefc77-da32-4b90-98df-97a0b6def37f-kube-api-access-tnnf9\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:14.946099 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:14.946071    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:15.013790 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.013759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-workload-socket\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.013919 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.013802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-istio-envoy\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.013919 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.013828    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-workload-certs\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.013919 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.013866    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-istio-data\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.013919 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.013890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65cefc77-da32-4b90-98df-97a0b6def37f-istio-token\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.014116 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.013922    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65cefc77-da32-4b90-98df-97a0b6def37f-istiod-ca-cert\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.014116 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.013974    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65cefc77-da32-4b90-98df-97a0b6def37f-istio-podinfo\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.014116 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.014005    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-credential-socket\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.014116 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.014056    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnnf9\" (UniqueName: \"kubernetes.io/projected/65cefc77-da32-4b90-98df-97a0b6def37f-kube-api-access-tnnf9\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.014421 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.014243    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-workload-socket\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.014421 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.014334    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-istio-data\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.014421 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.014397    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-workload-certs\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.014536 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.014487    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-credential-socket\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.014997 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.014969    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65cefc77-da32-4b90-98df-97a0b6def37f-istiod-ca-cert\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.016467 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.016399    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-istio-envoy\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.016981 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.016964    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65cefc77-da32-4b90-98df-97a0b6def37f-istio-podinfo\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.021220 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.021169    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65cefc77-da32-4b90-98df-97a0b6def37f-istio-token\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.021394 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.021373    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnnf9\" (UniqueName: \"kubernetes.io/projected/65cefc77-da32-4b90-98df-97a0b6def37f-kube-api-access-tnnf9\") pod \"e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") " pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.046757 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.046668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:15.099498 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.099461    2562 patch_prober.go:28] interesting pod/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 19 15:31:15.099642 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.099524    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr" podUID="d0bfabdf-0878-4f05-aa65-764af7a03526" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 15:31:15.105767 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.105747    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:15.382864 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.382839    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"]
Sep 19 15:31:15.384831 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:31:15.384802    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65cefc77_da32_4b90_98df_97a0b6def37f.slice/crio-a1d9453277a1e792187b83c4218074a7d1cd57cbeaa455ce66f9337f070e8adb WatchSource:0}: Error finding container a1d9453277a1e792187b83c4218074a7d1cd57cbeaa455ce66f9337f070e8adb: Status 404 returned error can't find the container with id a1d9453277a1e792187b83c4218074a7d1cd57cbeaa455ce66f9337f070e8adb
Sep 19 15:31:15.387087 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.387054    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:31:15.387156 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.387119    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:31:15.387156 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.387150    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:31:15.590740 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.590704    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv" event={"ID":"65cefc77-da32-4b90-98df-97a0b6def37f","Type":"ContainerStarted","Data":"18792b4738f5ec26f0fd2343d1c516404740d48298c2a33569d8613f6c75872c"}
Sep 19 15:31:15.590914 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.590768    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv" event={"ID":"65cefc77-da32-4b90-98df-97a0b6def37f","Type":"ContainerStarted","Data":"a1d9453277a1e792187b83c4218074a7d1cd57cbeaa455ce66f9337f070e8adb"}
Sep 19 15:31:15.610756 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.610701    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv" podStartSLOduration=1.6106865940000001 podStartE2EDuration="1.610686594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:31:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:31:15.609600963 +0000 UTC m=+1138.773016024" watchObservedRunningTime="2026-09-19 15:31:15.610686594 +0000 UTC m=+1138.774101633"
Sep 19 15:31:15.692646 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:15.692558    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:16.106850 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:16.106816    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:16.112359 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:16.112335    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:16.441403 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:16.441324    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:16.596853 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:16.596822    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:16.597879 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:16.597858    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:17.077619 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:17.077588    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:17.177745 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:17.177712    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:17.280269 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:17.280235    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:17.990382 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:17.990309    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:18.050432 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:18.050404    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:18.419023 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:18.418990    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:18.519373 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:18.519339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:18.587401 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:18.587365    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:18.804397 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:18.804371    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:19.200772 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.200746    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:31:19.361938 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.361873    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-data\") pod \"d0bfabdf-0878-4f05-aa65-764af7a03526\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") "
Sep 19 15:31:19.361938 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.361909    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-envoy\") pod \"d0bfabdf-0878-4f05-aa65-764af7a03526\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") "
Sep 19 15:31:19.362099 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.361943    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-workload-socket\") pod \"d0bfabdf-0878-4f05-aa65-764af7a03526\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") "
Sep 19 15:31:19.362099 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.362034    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-token\") pod \"d0bfabdf-0878-4f05-aa65-764af7a03526\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") "
Sep 19 15:31:19.362099 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.362067    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n5vq\" (UniqueName: \"kubernetes.io/projected/d0bfabdf-0878-4f05-aa65-764af7a03526-kube-api-access-4n5vq\") pod \"d0bfabdf-0878-4f05-aa65-764af7a03526\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") "
Sep 19 15:31:19.362278 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.362102    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-workload-certs\") pod \"d0bfabdf-0878-4f05-aa65-764af7a03526\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") "
Sep 19 15:31:19.362278 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.362127    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-credential-socket\") pod \"d0bfabdf-0878-4f05-aa65-764af7a03526\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") "
Sep 19 15:31:19.362278 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.362157    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-data" (OuterVolumeSpecName: "istio-data") pod "d0bfabdf-0878-4f05-aa65-764af7a03526" (UID: "d0bfabdf-0878-4f05-aa65-764af7a03526"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:31:19.362278 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.362166    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0bfabdf-0878-4f05-aa65-764af7a03526-istiod-ca-cert\") pod \"d0bfabdf-0878-4f05-aa65-764af7a03526\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") "
Sep 19 15:31:19.362492 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.362299    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-podinfo\") pod \"d0bfabdf-0878-4f05-aa65-764af7a03526\" (UID: \"d0bfabdf-0878-4f05-aa65-764af7a03526\") "
Sep 19 15:31:19.362581 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.362289    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d0bfabdf-0878-4f05-aa65-764af7a03526" (UID: "d0bfabdf-0878-4f05-aa65-764af7a03526"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:31:19.362581 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.362474    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d0bfabdf-0878-4f05-aa65-764af7a03526" (UID: "d0bfabdf-0878-4f05-aa65-764af7a03526"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:31:19.362581 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.362522    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0bfabdf-0878-4f05-aa65-764af7a03526-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d0bfabdf-0878-4f05-aa65-764af7a03526" (UID: "d0bfabdf-0878-4f05-aa65-764af7a03526"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:31:19.362581 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.362488    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d0bfabdf-0878-4f05-aa65-764af7a03526" (UID: "d0bfabdf-0878-4f05-aa65-764af7a03526"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:31:19.362885 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.362697    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0bfabdf-0878-4f05-aa65-764af7a03526-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:31:19.362885 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.362715    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:31:19.362885 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.362723    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:31:19.362885 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.362731    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:31:19.362885 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.362739    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:31:19.364356 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.364333    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d0bfabdf-0878-4f05-aa65-764af7a03526" (UID: "d0bfabdf-0878-4f05-aa65-764af7a03526"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:31:19.364455 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.364404    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0bfabdf-0878-4f05-aa65-764af7a03526-kube-api-access-4n5vq" (OuterVolumeSpecName: "kube-api-access-4n5vq") pod "d0bfabdf-0878-4f05-aa65-764af7a03526" (UID: "d0bfabdf-0878-4f05-aa65-764af7a03526"). InnerVolumeSpecName "kube-api-access-4n5vq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:31:19.364503 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.364479    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d0bfabdf-0878-4f05-aa65-764af7a03526" (UID: "d0bfabdf-0878-4f05-aa65-764af7a03526"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:31:19.364642 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.364610    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-token" (OuterVolumeSpecName: "istio-token") pod "d0bfabdf-0878-4f05-aa65-764af7a03526" (UID: "d0bfabdf-0878-4f05-aa65-764af7a03526"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:31:19.464213 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.464175    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:31:19.464308 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.464221    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n5vq\" (UniqueName: \"kubernetes.io/projected/d0bfabdf-0878-4f05-aa65-764af7a03526-kube-api-access-4n5vq\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:31:19.464308 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.464232    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:31:19.464308 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.464241    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0bfabdf-0878-4f05-aa65-764af7a03526-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:31:19.542417 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.542386    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:19.615262 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.615185    2562 generic.go:356] "Generic (PLEG): container finished" podID="d0bfabdf-0878-4f05-aa65-764af7a03526" containerID="208b542906aa89d72f3dbc5c5ac113a7832c89b3f2abcaae10a637a2574dacd7" exitCode=0
Sep 19 15:31:19.615262 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.615251    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"
Sep 19 15:31:19.615425 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.615266    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr" event={"ID":"d0bfabdf-0878-4f05-aa65-764af7a03526","Type":"ContainerDied","Data":"208b542906aa89d72f3dbc5c5ac113a7832c89b3f2abcaae10a637a2574dacd7"}
Sep 19 15:31:19.615425 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.615321    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr" event={"ID":"d0bfabdf-0878-4f05-aa65-764af7a03526","Type":"ContainerDied","Data":"9a8ca30ea41f2ffc8b66fa0013eac653971863c85b78122b877caf8f1fbe5f88"}
Sep 19 15:31:19.615425 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.615342    2562 scope.go:117] "RemoveContainer" containerID="208b542906aa89d72f3dbc5c5ac113a7832c89b3f2abcaae10a637a2574dacd7"
Sep 19 15:31:19.624738 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.624719    2562 scope.go:117] "RemoveContainer" containerID="d9fd721f8ba14d42c67b5bdf19c65be5f2c0ee858eb42f5ececafa7baeb2c141"
Sep 19 15:31:19.632974 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.632957    2562 scope.go:117] "RemoveContainer" containerID="208b542906aa89d72f3dbc5c5ac113a7832c89b3f2abcaae10a637a2574dacd7"
Sep 19 15:31:19.633340 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:31:19.633314    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"208b542906aa89d72f3dbc5c5ac113a7832c89b3f2abcaae10a637a2574dacd7\": container with ID starting with 208b542906aa89d72f3dbc5c5ac113a7832c89b3f2abcaae10a637a2574dacd7 not found: ID does not exist" containerID="208b542906aa89d72f3dbc5c5ac113a7832c89b3f2abcaae10a637a2574dacd7"
Sep 19 15:31:19.633423 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.633349    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"208b542906aa89d72f3dbc5c5ac113a7832c89b3f2abcaae10a637a2574dacd7"} err="failed to get container status \"208b542906aa89d72f3dbc5c5ac113a7832c89b3f2abcaae10a637a2574dacd7\": rpc error: code = NotFound desc = could not find container \"208b542906aa89d72f3dbc5c5ac113a7832c89b3f2abcaae10a637a2574dacd7\": container with ID starting with 208b542906aa89d72f3dbc5c5ac113a7832c89b3f2abcaae10a637a2574dacd7 not found: ID does not exist"
Sep 19 15:31:19.633423 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.633376    2562 scope.go:117] "RemoveContainer" containerID="d9fd721f8ba14d42c67b5bdf19c65be5f2c0ee858eb42f5ececafa7baeb2c141"
Sep 19 15:31:19.633773 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:31:19.633649    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9fd721f8ba14d42c67b5bdf19c65be5f2c0ee858eb42f5ececafa7baeb2c141\": container with ID starting with d9fd721f8ba14d42c67b5bdf19c65be5f2c0ee858eb42f5ececafa7baeb2c141 not found: ID does not exist" containerID="d9fd721f8ba14d42c67b5bdf19c65be5f2c0ee858eb42f5ececafa7baeb2c141"
Sep 19 15:31:19.633773 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.633684    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9fd721f8ba14d42c67b5bdf19c65be5f2c0ee858eb42f5ececafa7baeb2c141"} err="failed to get container status \"d9fd721f8ba14d42c67b5bdf19c65be5f2c0ee858eb42f5ececafa7baeb2c141\": rpc error: code = NotFound desc = could not find container \"d9fd721f8ba14d42c67b5bdf19c65be5f2c0ee858eb42f5ececafa7baeb2c141\": container with ID starting with d9fd721f8ba14d42c67b5bdf19c65be5f2c0ee858eb42f5ececafa7baeb2c141 not found: ID does not exist"
Sep 19 15:31:19.635684 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.635665    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"]
Sep 19 15:31:19.638950 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:19.638931    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr"]
Sep 19 15:31:20.185088 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:20.185060    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:20.813153 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:20.813121    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:21.345080 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:21.345046    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0bfabdf-0878-4f05-aa65-764af7a03526" path="/var/lib/kubelet/pods/d0bfabdf-0878-4f05-aa65-764af7a03526/volumes"
Sep 19 15:31:32.639351 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:32.639318    2562 patch_prober.go:28] interesting pod/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 19 15:31:32.639745 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:32.639376    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv" podUID="65cefc77-da32-4b90-98df-97a0b6def37f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 19 15:31:33.338082 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:33.338049    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:31:33.692790 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:33.692703    2562 generic.go:356] "Generic (PLEG): container finished" podID="65cefc77-da32-4b90-98df-97a0b6def37f" containerID="18792b4738f5ec26f0fd2343d1c516404740d48298c2a33569d8613f6c75872c" exitCode=0
Sep 19 15:31:33.692790 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:33.692780    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv" event={"ID":"65cefc77-da32-4b90-98df-97a0b6def37f","Type":"ContainerDied","Data":"18792b4738f5ec26f0fd2343d1c516404740d48298c2a33569d8613f6c75872c"}
Sep 19 15:31:33.693307 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:33.693258    2562 scope.go:117] "RemoveContainer" containerID="18792b4738f5ec26f0fd2343d1c516404740d48298c2a33569d8613f6c75872c"
Sep 19 15:31:33.694571 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:33.694535    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:31:33.694680 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:33.694622    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:31:33.694680 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:33.694657    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:31:34.703622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:34.703576    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv" event={"ID":"65cefc77-da32-4b90-98df-97a0b6def37f","Type":"ContainerStarted","Data":"5d08503afd6170e7b23564bfe6519202949abd63a5fe364287ca23509bba24ec"}
Sep 19 15:31:35.106884 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:35.106805    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:35.106884 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:35.106841    2562 patch_prober.go:28] interesting pod/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 19 15:31:35.107157 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:35.106904    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv" podUID="65cefc77-da32-4b90-98df-97a0b6def37f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 19 15:31:36.106942 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:36.106461    2562 patch_prober.go:28] interesting pod/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 19 15:31:36.106942 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:36.106529    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv" podUID="65cefc77-da32-4b90-98df-97a0b6def37f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 19 15:31:37.106967 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:37.106504    2562 patch_prober.go:28] interesting pod/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 19 15:31:37.106967 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:37.106569    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv" podUID="65cefc77-da32-4b90-98df-97a0b6def37f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 19 15:31:38.106897 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.106864    2562 patch_prober.go:28] interesting pod/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 19 15:31:38.107214 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.107159    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv" podUID="65cefc77-da32-4b90-98df-97a0b6def37f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 19 15:31:38.229507 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.229478    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"]
Sep 19 15:31:38.229946 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.229920    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0bfabdf-0878-4f05-aa65-764af7a03526" containerName="istio-proxy"
Sep 19 15:31:38.229946 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.229941    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0bfabdf-0878-4f05-aa65-764af7a03526" containerName="istio-proxy"
Sep 19 15:31:38.230159 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.230016    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0bfabdf-0878-4f05-aa65-764af7a03526" containerName="istio-proxy"
Sep 19 15:31:38.230159 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.230025    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0bfabdf-0878-4f05-aa65-764af7a03526" containerName="istio-proxy"
Sep 19 15:31:38.232409 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.232388    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.234551 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.234531    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-21d2a4\"/\"kube-root-ca.crt\""
Sep 19 15:31:38.234551 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.234557    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-21d2a4\"/\"openshift-service-ca.crt\""
Sep 19 15:31:38.235394 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.235372    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-21d2a4\"/\"default-dockercfg-fhtvh\""
Sep 19 15:31:38.235509 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.235395    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-21d2a4\"/\"test-model-21d2a4-kserve-self-signed-certs\""
Sep 19 15:31:38.242335 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.242313    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"]
Sep 19 15:31:38.257498 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.257402    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:38.259722 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.259700    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-dshm\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.259830 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.259753    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hbpq\" (UniqueName: \"kubernetes.io/projected/8a6255ff-7058-4b28-9fca-08874b7d9c25-kube-api-access-9hbpq\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.259902 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.259854    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a6255ff-7058-4b28-9fca-08874b7d9c25-tls-certs\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.259902 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.259893    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-home\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.260014 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.259915    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-tmp-dir\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.260014 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.259935    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-model-cache\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.361057 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.360968    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-home\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.361057 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.361000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-tmp-dir\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.361057 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.361017    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-model-cache\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.361351 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.361059    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-dshm\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.361351 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.361107    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hbpq\" (UniqueName: \"kubernetes.io/projected/8a6255ff-7058-4b28-9fca-08874b7d9c25-kube-api-access-9hbpq\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.361351 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.361208    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a6255ff-7058-4b28-9fca-08874b7d9c25-tls-certs\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.361504 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.361450    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-home\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.361504 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.361468    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-tmp-dir\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.361598 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.361526    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-model-cache\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.363742 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.363721    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-dshm\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.363972 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.363955    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a6255ff-7058-4b28-9fca-08874b7d9c25-tls-certs\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.369065 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.369045    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hbpq\" (UniqueName: \"kubernetes.io/projected/8a6255ff-7058-4b28-9fca-08874b7d9c25-kube-api-access-9hbpq\") pod \"test-model-21d2a4-kserve-5545d4f8bf-r5ffj\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") " pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.544009 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.543925    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:38.840245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:38.840220    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"]
Sep 19 15:31:38.842262 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:31:38.842231    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a6255ff_7058_4b28_9fca_08874b7d9c25.slice/crio-36cc7e256239fc08c92706b2810227c400411484de9bbdc3e76ac97e02308a87 WatchSource:0}: Error finding container 36cc7e256239fc08c92706b2810227c400411484de9bbdc3e76ac97e02308a87: Status 404 returned error can't find the container with id 36cc7e256239fc08c92706b2810227c400411484de9bbdc3e76ac97e02308a87
Sep 19 15:31:39.106185 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:39.106142    2562 patch_prober.go:28] interesting pod/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 19 15:31:39.106400 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:39.106233    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv" podUID="65cefc77-da32-4b90-98df-97a0b6def37f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 19 15:31:39.740103 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:39.740060    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj" event={"ID":"8a6255ff-7058-4b28-9fca-08874b7d9c25","Type":"ContainerStarted","Data":"b353d06b45bdf7132977f0b989ebd132bc76281bae637c37efbf842991c3ecb6"}
Sep 19 15:31:39.740478 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:39.740115    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj" event={"ID":"8a6255ff-7058-4b28-9fca-08874b7d9c25","Type":"ContainerStarted","Data":"36cc7e256239fc08c92706b2810227c400411484de9bbdc3e76ac97e02308a87"}
Sep 19 15:31:39.757927 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:39.757863    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj" podStartSLOduration=1.757841904 podStartE2EDuration="1.757841904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:31:39.754601365 +0000 UTC m=+1162.918016492" watchObservedRunningTime="2026-09-19 15:31:39.757841904 +0000 UTC m=+1162.921256945"
Sep 19 15:31:40.110463 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:40.110431    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:40.110735 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:40.110715    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:40.111458 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:40.111439    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:31:42.326989 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:42.326958    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:43.066134 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:43.066096    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:43.867581 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:43.867548    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:44.624595 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:44.624565    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:45.222650 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:45.222618    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:45.728353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:45.728318    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:47.801704 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:47.801663    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:48.544846 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:48.544816    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:48.544846 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:48.544852    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:48.557865 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:48.557841    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:48.650063 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:48.650039    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:48.805558 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:48.805479    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:31:49.159927 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:49.159845    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:49.848623 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:49.848591    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:50.453337 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:50.453301    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:51.047087 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:51.047055    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:53.744102 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:53.744065    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:31:58.749305 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:58.749271    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:58.806497 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:58.806458    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:58.906219 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:58.906170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:58.968531 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:58.968473    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:59.037903 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:59.037871    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"]
Sep 19 15:31:59.038380 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:59.038349    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv" podUID="65cefc77-da32-4b90-98df-97a0b6def37f" containerName="istio-proxy" containerID="cri-o://5d08503afd6170e7b23564bfe6519202949abd63a5fe364287ca23509bba24ec" gracePeriod=30
Sep 19 15:31:59.059791 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:59.059723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:59.346099 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:59.346022    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:59.469493 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:59.469466    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:31:59.789050 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:31:59.789021    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:00.029347 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:00.029314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:00.129615 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:00.129540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:00.550247 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:00.550222    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:01.196309 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:01.196279    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:01.856283 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:01.856251    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:04.296572 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.296525    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:32:04.320646 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.320571    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65cefc77-da32-4b90-98df-97a0b6def37f-istiod-ca-cert\") pod \"65cefc77-da32-4b90-98df-97a0b6def37f\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") "
Sep 19 15:32:04.320646 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.320617    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-workload-socket\") pod \"65cefc77-da32-4b90-98df-97a0b6def37f\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") "
Sep 19 15:32:04.320847 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.320661    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-istio-data\") pod \"65cefc77-da32-4b90-98df-97a0b6def37f\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") "
Sep 19 15:32:04.320847 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.320801    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-credential-socket\") pod \"65cefc77-da32-4b90-98df-97a0b6def37f\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") "
Sep 19 15:32:04.320847 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.320841    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-workload-certs\") pod \"65cefc77-da32-4b90-98df-97a0b6def37f\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") "
Sep 19 15:32:04.320973 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.320866    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65cefc77-da32-4b90-98df-97a0b6def37f-istio-token\") pod \"65cefc77-da32-4b90-98df-97a0b6def37f\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") "
Sep 19 15:32:04.320973 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.320896    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65cefc77-da32-4b90-98df-97a0b6def37f-istio-podinfo\") pod \"65cefc77-da32-4b90-98df-97a0b6def37f\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") "
Sep 19 15:32:04.320973 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.320932    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-istio-data" (OuterVolumeSpecName: "istio-data") pod "65cefc77-da32-4b90-98df-97a0b6def37f" (UID: "65cefc77-da32-4b90-98df-97a0b6def37f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:32:04.321070 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.320942    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-istio-envoy\") pod \"65cefc77-da32-4b90-98df-97a0b6def37f\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") "
Sep 19 15:32:04.321070 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.321004    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "65cefc77-da32-4b90-98df-97a0b6def37f" (UID: "65cefc77-da32-4b90-98df-97a0b6def37f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:32:04.321137 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.321063    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65cefc77-da32-4b90-98df-97a0b6def37f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "65cefc77-da32-4b90-98df-97a0b6def37f" (UID: "65cefc77-da32-4b90-98df-97a0b6def37f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:32:04.321350 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.321327    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "65cefc77-da32-4b90-98df-97a0b6def37f" (UID: "65cefc77-da32-4b90-98df-97a0b6def37f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:32:04.321451 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.321345    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "65cefc77-da32-4b90-98df-97a0b6def37f" (UID: "65cefc77-da32-4b90-98df-97a0b6def37f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:32:04.321451 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.321439    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65cefc77-da32-4b90-98df-97a0b6def37f-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:32:04.321553 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.321459    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:32:04.321553 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.321474    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:32:04.321553 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.321487    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:32:04.321553 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.321500    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:32:04.323895 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.323863    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65cefc77-da32-4b90-98df-97a0b6def37f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "65cefc77-da32-4b90-98df-97a0b6def37f" (UID: "65cefc77-da32-4b90-98df-97a0b6def37f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:32:04.323991 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.323914    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "65cefc77-da32-4b90-98df-97a0b6def37f" (UID: "65cefc77-da32-4b90-98df-97a0b6def37f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:32:04.323991 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.323967    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65cefc77-da32-4b90-98df-97a0b6def37f-istio-token" (OuterVolumeSpecName: "istio-token") pod "65cefc77-da32-4b90-98df-97a0b6def37f" (UID: "65cefc77-da32-4b90-98df-97a0b6def37f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:32:04.422086 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.422041    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnnf9\" (UniqueName: \"kubernetes.io/projected/65cefc77-da32-4b90-98df-97a0b6def37f-kube-api-access-tnnf9\") pod \"65cefc77-da32-4b90-98df-97a0b6def37f\" (UID: \"65cefc77-da32-4b90-98df-97a0b6def37f\") "
Sep 19 15:32:04.422481 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.422462    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65cefc77-da32-4b90-98df-97a0b6def37f-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:32:04.422481 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.422481    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65cefc77-da32-4b90-98df-97a0b6def37f-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:32:04.422608 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.422489    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65cefc77-da32-4b90-98df-97a0b6def37f-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:32:04.424374 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.424353    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65cefc77-da32-4b90-98df-97a0b6def37f-kube-api-access-tnnf9" (OuterVolumeSpecName: "kube-api-access-tnnf9") pod "65cefc77-da32-4b90-98df-97a0b6def37f" (UID: "65cefc77-da32-4b90-98df-97a0b6def37f"). InnerVolumeSpecName "kube-api-access-tnnf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:32:04.523552 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.523522    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnnf9\" (UniqueName: \"kubernetes.io/projected/65cefc77-da32-4b90-98df-97a0b6def37f-kube-api-access-tnnf9\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:32:04.861836 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.861801    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:04.897395 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.897365    2562 generic.go:356] "Generic (PLEG): container finished" podID="65cefc77-da32-4b90-98df-97a0b6def37f" containerID="5d08503afd6170e7b23564bfe6519202949abd63a5fe364287ca23509bba24ec" exitCode=0
Sep 19 15:32:04.897543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.897398    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv" event={"ID":"65cefc77-da32-4b90-98df-97a0b6def37f","Type":"ContainerDied","Data":"5d08503afd6170e7b23564bfe6519202949abd63a5fe364287ca23509bba24ec"}
Sep 19 15:32:04.897543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.897413    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"
Sep 19 15:32:04.897543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.897434    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv" event={"ID":"65cefc77-da32-4b90-98df-97a0b6def37f","Type":"ContainerDied","Data":"a1d9453277a1e792187b83c4218074a7d1cd57cbeaa455ce66f9337f070e8adb"}
Sep 19 15:32:04.897543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.897455    2562 scope.go:117] "RemoveContainer" containerID="5d08503afd6170e7b23564bfe6519202949abd63a5fe364287ca23509bba24ec"
Sep 19 15:32:04.908494 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.908478    2562 scope.go:117] "RemoveContainer" containerID="18792b4738f5ec26f0fd2343d1c516404740d48298c2a33569d8613f6c75872c"
Sep 19 15:32:04.916863 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.916833    2562 scope.go:117] "RemoveContainer" containerID="5d08503afd6170e7b23564bfe6519202949abd63a5fe364287ca23509bba24ec"
Sep 19 15:32:04.917271 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:32:04.917218    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d08503afd6170e7b23564bfe6519202949abd63a5fe364287ca23509bba24ec\": container with ID starting with 5d08503afd6170e7b23564bfe6519202949abd63a5fe364287ca23509bba24ec not found: ID does not exist" containerID="5d08503afd6170e7b23564bfe6519202949abd63a5fe364287ca23509bba24ec"
Sep 19 15:32:04.917271 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.917256    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d08503afd6170e7b23564bfe6519202949abd63a5fe364287ca23509bba24ec"} err="failed to get container status \"5d08503afd6170e7b23564bfe6519202949abd63a5fe364287ca23509bba24ec\": rpc error: code = NotFound desc = could not find container \"5d08503afd6170e7b23564bfe6519202949abd63a5fe364287ca23509bba24ec\": container with ID starting with 5d08503afd6170e7b23564bfe6519202949abd63a5fe364287ca23509bba24ec not found: ID does not exist"
Sep 19 15:32:04.917428 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.917281    2562 scope.go:117] "RemoveContainer" containerID="18792b4738f5ec26f0fd2343d1c516404740d48298c2a33569d8613f6c75872c"
Sep 19 15:32:04.917582 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:32:04.917566    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18792b4738f5ec26f0fd2343d1c516404740d48298c2a33569d8613f6c75872c\": container with ID starting with 18792b4738f5ec26f0fd2343d1c516404740d48298c2a33569d8613f6c75872c not found: ID does not exist" containerID="18792b4738f5ec26f0fd2343d1c516404740d48298c2a33569d8613f6c75872c"
Sep 19 15:32:04.917622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.917589    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18792b4738f5ec26f0fd2343d1c516404740d48298c2a33569d8613f6c75872c"} err="failed to get container status \"18792b4738f5ec26f0fd2343d1c516404740d48298c2a33569d8613f6c75872c\": rpc error: code = NotFound desc = could not find container \"18792b4738f5ec26f0fd2343d1c516404740d48298c2a33569d8613f6c75872c\": container with ID starting with 18792b4738f5ec26f0fd2343d1c516404740d48298c2a33569d8613f6c75872c not found: ID does not exist"
Sep 19 15:32:04.919601 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.919585    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"]
Sep 19 15:32:04.922450 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:04.922431    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv"]
Sep 19 15:32:05.344435 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:05.344405    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65cefc77-da32-4b90-98df-97a0b6def37f" path="/var/lib/kubelet/pods/65cefc77-da32-4b90-98df-97a0b6def37f/volumes"
Sep 19 15:32:05.493519 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:05.493489    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:05.680906 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:05.680828    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:05.772546 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:05.772516    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:06.261979 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:06.261949    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:06.888062 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:06.888031    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:07.648677 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:07.648640    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:08.271642 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:08.271601    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:08.371929 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:08.371894    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:08.473656 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:08.473621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:08.699985 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:08.699957    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:08.797818 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:08.797790    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:09.736259 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:09.736232    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:32:11.622796 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:11.622769    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:28.037189 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:28.037148    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:32:29.942561 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:29.942529    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"]
Sep 19 15:32:29.942956 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:29.942944    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65cefc77-da32-4b90-98df-97a0b6def37f" containerName="istio-proxy"
Sep 19 15:32:29.943005 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:29.942958    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="65cefc77-da32-4b90-98df-97a0b6def37f" containerName="istio-proxy"
Sep 19 15:32:29.943005 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:29.942967    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0bfabdf-0878-4f05-aa65-764af7a03526" containerName="istio-proxy"
Sep 19 15:32:29.943005 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:29.942972    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0bfabdf-0878-4f05-aa65-764af7a03526" containerName="istio-proxy"
Sep 19 15:32:29.943005 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:29.942979    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65cefc77-da32-4b90-98df-97a0b6def37f" containerName="istio-proxy"
Sep 19 15:32:29.943005 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:29.942985    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="65cefc77-da32-4b90-98df-97a0b6def37f" containerName="istio-proxy"
Sep 19 15:32:29.943158 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:29.943056    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="65cefc77-da32-4b90-98df-97a0b6def37f" containerName="istio-proxy"
Sep 19 15:32:29.943158 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:29.943065    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="65cefc77-da32-4b90-98df-97a0b6def37f" containerName="istio-proxy"
Sep 19 15:32:29.946162 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:29.946146    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:29.948602 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:29.948582    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-33737b\"/\"kube-root-ca.crt\""
Sep 19 15:32:29.949534 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:29.949507    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-33737b\"/\"premium-w3-33737b-kserve-self-signed-certs\""
Sep 19 15:32:29.949620 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:29.949562    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-33737b\"/\"default-dockercfg-4tlbw\""
Sep 19 15:32:29.949620 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:29.949562    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-33737b\"/\"openshift-service-ca.crt\""
Sep 19 15:32:29.955163 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:29.955142    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"]
Sep 19 15:32:29.966190 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:29.966158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:30.075518 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.075491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4m2s\" (UniqueName: \"kubernetes.io/projected/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-kube-api-access-s4m2s\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.075656 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.075521    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-model-cache\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.075656 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.075562    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-tmp-dir\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.075778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.075706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-dshm\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.075778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.075739    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-tls-certs\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.075862 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.075805    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-home\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.176519 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.176482    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-home\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.176728 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.176546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4m2s\" (UniqueName: \"kubernetes.io/projected/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-kube-api-access-s4m2s\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.176728 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.176577    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-model-cache\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.176728 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.176628    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-tmp-dir\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.176900 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.176729    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-dshm\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.176900 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.176752    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-tls-certs\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.177033 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.176927    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-home\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.177033 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.176945    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-model-cache\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.177033 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.177010    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-tmp-dir\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.179007 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.178987    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-dshm\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.179282 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.179265    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-tls-certs\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.183666 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.183644    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4m2s\" (UniqueName: \"kubernetes.io/projected/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-kube-api-access-s4m2s\") pod \"premium-w3-33737b-kserve-568bfc5dd6-7nlr2\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") " pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.256397 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.256339    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:30.548106 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:30.548072    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"]
Sep 19 15:32:30.552047 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:32:30.552023    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b2d8a6c_92e6_4a55_a424_b524bdc28fe7.slice/crio-cae49ce37917886d2c770246d0c74d821c64b24a069ec22299ba1b1e156a4271 WatchSource:0}: Error finding container cae49ce37917886d2c770246d0c74d821c64b24a069ec22299ba1b1e156a4271: Status 404 returned error can't find the container with id cae49ce37917886d2c770246d0c74d821c64b24a069ec22299ba1b1e156a4271
Sep 19 15:32:31.051154 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:31.051120    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2" event={"ID":"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7","Type":"ContainerStarted","Data":"15e3776d6d58ebd1196d0ca18529b8a6bbb6d35da8c6f90d519f2a84c7b156f1"}
Sep 19 15:32:31.051569 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:31.051165    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2" event={"ID":"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7","Type":"ContainerStarted","Data":"cae49ce37917886d2c770246d0c74d821c64b24a069ec22299ba1b1e156a4271"}
Sep 19 15:32:31.065428 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:31.065388    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2" podStartSLOduration=2.065372084 podStartE2EDuration="2.065372084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:32:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:32:31.065111885 +0000 UTC m=+1214.228526925" watchObservedRunningTime="2026-09-19 15:32:31.065372084 +0000 UTC m=+1214.228787123"
Sep 19 15:32:31.450140 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:31.450047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:31.968684 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:31.968647    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:32.657544 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:32.657506    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:33.375811 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:33.375779    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:34.045372 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:34.045309    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:34.758528 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:34.758494    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:37.337901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:37.337870    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:37.953419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:37.953384    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:38.655803 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:38.655768    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:39.367743 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:39.367701    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:39.961349 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:39.961322    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:40.257335 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:40.257255    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:40.257500 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:40.257338    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:40.270645 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:40.270624    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:40.554131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:40.554105    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:41.115725 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:41.115695    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:32:47.231790 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:47.231754    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:47.291505 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:47.291468    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:47.354944 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:47.354916    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:47.411550 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:47.411522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:47.460841 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:47.460816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:47.850266 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:47.850229    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:48.349577 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:48.349544    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:32:48.372127 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:48.372062    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:48.522640 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:48.522604    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:48.937092 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:48.937053    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:49.226673 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:49.226598    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:49.331147 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:49.331111    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:49.713529 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:49.713496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:49.893106 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:49.893075    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:50.757936 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:50.757904    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:51.458120 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:51.458090    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:51.879062 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:51.879036    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:51.974766 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:51.974736    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:52.164900 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:52.164823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:52.871184 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:52.871153    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:53.568168 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:53.568135    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:54.150543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:54.150503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:54.887377 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:54.887348    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:54.984891 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:54.984859    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:55.086555 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:55.086526    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:55.384242 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:55.384215    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:55.482387 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:55.482355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:32:56.916760 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:32:56.916733    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:00.660175 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:00.660137    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:00.758026 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:00.757995    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:10.341984 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:10.341950    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:33:17.409553 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:17.409514    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:18.185562 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:18.185530    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:18.686398 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:18.686367    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:19.457262 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:19.457225    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:20.073756 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:20.073725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:20.747805 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:20.747772    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:21.808306 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:21.808276    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-24d51017-58452"]
Sep 19 15:33:21.811843 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:21.811824    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-24d51017-58452"
Sep 19 15:33:21.813905 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:21.813886    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 15:33:21.813990 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:21.813891    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7znsl\""
Sep 19 15:33:21.818427 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:21.818407    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-24d51017-58452"]
Sep 19 15:33:21.984442 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:21.984409    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/886a6dd0-5094-41af-acf6-d4c1e83aa925-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-24d51017-58452\" (UID: \"886a6dd0-5094-41af-acf6-d4c1e83aa925\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-24d51017-58452"
Sep 19 15:33:22.085111 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:22.085027    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/886a6dd0-5094-41af-acf6-d4c1e83aa925-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-24d51017-58452\" (UID: \"886a6dd0-5094-41af-acf6-d4c1e83aa925\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-24d51017-58452"
Sep 19 15:33:22.085714 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:22.085687    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/886a6dd0-5094-41af-acf6-d4c1e83aa925-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-24d51017-58452\" (UID: \"886a6dd0-5094-41af-acf6-d4c1e83aa925\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-24d51017-58452"
Sep 19 15:33:22.125048 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:22.125014    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-24d51017-58452"
Sep 19 15:33:22.394249 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:22.394219    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-24d51017-58452"]
Sep 19 15:33:22.395377 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:33:22.395349    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod886a6dd0_5094_41af_acf6_d4c1e83aa925.slice/crio-c1c9e3333d39331662c3ad47b19ab90fda2735381d3571e827d71559be48944d WatchSource:0}: Error finding container c1c9e3333d39331662c3ad47b19ab90fda2735381d3571e827d71559be48944d: Status 404 returned error can't find the container with id c1c9e3333d39331662c3ad47b19ab90fda2735381d3571e827d71559be48944d
Sep 19 15:33:22.595633 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:22.595599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:22.881854 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:22.881817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:23.346016 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:23.345982    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-24d51017-58452" event={"ID":"886a6dd0-5094-41af-acf6-d4c1e83aa925","Type":"ContainerStarted","Data":"c1c9e3333d39331662c3ad47b19ab90fda2735381d3571e827d71559be48944d"}
Sep 19 15:33:23.438595 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:23.438563    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:24.169379 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:24.169338    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:24.846951 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:24.846919    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:25.351166 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:25.351134    2562 generic.go:356] "Generic (PLEG): container finished" podID="886a6dd0-5094-41af-acf6-d4c1e83aa925" containerID="30f7ed26ad1f8b5aea17303dbd5746642d050210e4cf871584264d2c7c37bc12" exitCode=0
Sep 19 15:33:25.351511 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:25.351228    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-24d51017-58452" event={"ID":"886a6dd0-5094-41af-acf6-d4c1e83aa925","Type":"ContainerDied","Data":"30f7ed26ad1f8b5aea17303dbd5746642d050210e4cf871584264d2c7c37bc12"}
Sep 19 15:33:25.683367 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:25.683287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:26.454428 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:26.454397    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:26.489950 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:26.489930    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-24d51017-58452"
Sep 19 15:33:26.533827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:26.533790    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/886a6dd0-5094-41af-acf6-d4c1e83aa925-maas-api-service-ca\") pod \"886a6dd0-5094-41af-acf6-d4c1e83aa925\" (UID: \"886a6dd0-5094-41af-acf6-d4c1e83aa925\") "
Sep 19 15:33:26.534157 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:26.534133    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/886a6dd0-5094-41af-acf6-d4c1e83aa925-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "886a6dd0-5094-41af-acf6-d4c1e83aa925" (UID: "886a6dd0-5094-41af-acf6-d4c1e83aa925"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:33:26.635133 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:26.635057    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/886a6dd0-5094-41af-acf6-d4c1e83aa925-maas-api-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:33:27.362653 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:27.362627    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-24d51017-58452"
Sep 19 15:33:27.362786 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:27.362667    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-24d51017-58452" event={"ID":"886a6dd0-5094-41af-acf6-d4c1e83aa925","Type":"ContainerDied","Data":"c1c9e3333d39331662c3ad47b19ab90fda2735381d3571e827d71559be48944d"}
Sep 19 15:33:27.362786 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:27.362706    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1c9e3333d39331662c3ad47b19ab90fda2735381d3571e827d71559be48944d"
Sep 19 15:33:33.625042 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:33.624998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:33.687915 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:33.687880    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:33.743308 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:33.743279    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:33.803336 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:33.803309    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-24d51017-58452"]
Sep 19 15:33:33.804600 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:33.804573    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:33.805451 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:33.805434    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-24d51017-58452"]
Sep 19 15:33:33.858059 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:33.858039    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:33.939955 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:33.939855    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:34.273850 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:34.273772    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:34.590123 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:34.590051    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:34.690509 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:34.690480    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:34.790961 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:34.790934    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:34.972965 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:34.972885    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:35.346580 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:35.346546    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="886a6dd0-5094-41af-acf6-d4c1e83aa925" path="/var/lib/kubelet/pods/886a6dd0-5094-41af-acf6-d4c1e83aa925/volumes"
Sep 19 15:33:35.875943 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:35.875890    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:36.098415 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:36.098384    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:36.481796 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:36.481763    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:37.115711 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.115674    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"]
Sep 19 15:33:37.116170 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.116112    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="886a6dd0-5094-41af-acf6-d4c1e83aa925" containerName="revoke-keys"
Sep 19 15:33:37.116170 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.116128    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="886a6dd0-5094-41af-acf6-d4c1e83aa925" containerName="revoke-keys"
Sep 19 15:33:37.116312 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.116270    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="886a6dd0-5094-41af-acf6-d4c1e83aa925" containerName="revoke-keys"
Sep 19 15:33:37.119712 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.119696    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.122130 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.122115    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-33737b\"/\"distinct-w3-33737b-kserve-self-signed-certs\""
Sep 19 15:33:37.126080 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.126059    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"]
Sep 19 15:33:37.233726 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.233690    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:37.237028 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.237008    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-model-cache\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.237092 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.237040    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1568a756-989f-4231-befe-64613b8021d9-tls-certs\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.237128 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.237089    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-dshm\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.237128 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.237115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-home\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.237239 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.237131    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74nbj\" (UniqueName: \"kubernetes.io/projected/1568a756-989f-4231-befe-64613b8021d9-kube-api-access-74nbj\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.237239 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.237231    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-tmp-dir\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.338820 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.338786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-tmp-dir\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.339013 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.338904    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-model-cache\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.339013 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.338932    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1568a756-989f-4231-befe-64613b8021d9-tls-certs\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.339013 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.338989    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-dshm\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.339178 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.339016    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-home\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.339178 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.339044    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74nbj\" (UniqueName: \"kubernetes.io/projected/1568a756-989f-4231-befe-64613b8021d9-kube-api-access-74nbj\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.339334 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.339282    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-tmp-dir\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.339483 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.339453    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-home\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.339589 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.339482    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-model-cache\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.341477 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.341454    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-dshm\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.341711 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.341693    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1568a756-989f-4231-befe-64613b8021d9-tls-certs\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.347230 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.347187    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74nbj\" (UniqueName: \"kubernetes.io/projected/1568a756-989f-4231-befe-64613b8021d9-kube-api-access-74nbj\") pod \"distinct-w3-33737b-kserve-54df58d7d5-xw5xb\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") " pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.430138 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.430063    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:37.431366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.431343    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:37.701457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:37.701115    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"]
Sep 19 15:33:38.423490 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:38.423451    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb" event={"ID":"1568a756-989f-4231-befe-64613b8021d9","Type":"ContainerStarted","Data":"a3f433ddb3566b18569edbf6687815d7215fac7a1a2addab78eb059c4869a55d"}
Sep 19 15:33:38.423869 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:38.423497    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb" event={"ID":"1568a756-989f-4231-befe-64613b8021d9","Type":"ContainerStarted","Data":"6d315e76cd10b33d3b59457930afb64db1cfbfca665553139f0c4bce544a562c"}
Sep 19 15:33:38.438951 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:38.438905    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb" podStartSLOduration=1.438886195 podStartE2EDuration="1.438886195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:33:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:33:38.437475036 +0000 UTC m=+1281.600890079" watchObservedRunningTime="2026-09-19 15:33:38.438886195 +0000 UTC m=+1281.602301235"
Sep 19 15:33:41.742302 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:41.742262    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:33:41.803539 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:41.803503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:41.904960 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:41.904928    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:42.003387 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:42.003308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:42.059359 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:42.059324    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:42.477014 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:42.476980    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:33:47.430650 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:47.430606    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:47.431116 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:47.430674    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:47.443016 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:47.442991    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:47.481864 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:47.481838    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:33:49.955317 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:33:49.955288    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:06.118506 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:06.118472    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:06.169156 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:06.169127    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:08.386887 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:08.386856    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:13.441859 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:13.441827    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:34:13.977449 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:13.977417    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:14.041206 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:14.041165    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:14.112836 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:14.112805    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:14.212710 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:14.212669    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:18.959611 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:18.959578    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:24.156333 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:24.156301    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:29.996800 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:29.996762    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:34.040504 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.040475    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"]
Sep 19 15:34:34.044600 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.044578    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.047009 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.046989    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-15949d\"/\"distinct-2-w0-15949d-kserve-self-signed-certs\""
Sep 19 15:34:34.051442 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.051421    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"]
Sep 19 15:34:34.065604 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.065578    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:34.109905 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.109877    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-home\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.110073 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.109965    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58b650c0-044b-4468-ae34-7ca78aa2e890-tls-certs\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.110073 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.110019    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-model-cache\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.110190 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.110097    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-tmp-dir\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.110190 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.110139    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-dshm\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.110327 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.110282    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws59d\" (UniqueName: \"kubernetes.io/projected/58b650c0-044b-4468-ae34-7ca78aa2e890-kube-api-access-ws59d\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.218184 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.211815    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-tmp-dir\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.218184 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.211867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-dshm\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.218184 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.211948    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws59d\" (UniqueName: \"kubernetes.io/projected/58b650c0-044b-4468-ae34-7ca78aa2e890-kube-api-access-ws59d\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.218184 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.211981    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-home\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.218184 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.212038    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58b650c0-044b-4468-ae34-7ca78aa2e890-tls-certs\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.218184 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.212099    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-model-cache\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.218184 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.212553    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-model-cache\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.218184 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.212803    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-tmp-dir\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.218184 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.213372    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-home\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.218184 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.216816    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-dshm\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.227526 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.224778    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58b650c0-044b-4468-ae34-7ca78aa2e890-tls-certs\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.228111 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.228063    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws59d\" (UniqueName: \"kubernetes.io/projected/58b650c0-044b-4468-ae34-7ca78aa2e890-kube-api-access-ws59d\") pod \"distinct-2-w0-15949d-kserve-586857bd9d-rzjv7\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") " pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.356669 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.356593    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:34.628730 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.628706    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"]
Sep 19 15:34:34.631312 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:34:34.631285    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58b650c0_044b_4468_ae34_7ca78aa2e890.slice/crio-6a0c4ca106bc56afa3e3da93e1f41a87958b63a6496679de092ac85186d24637 WatchSource:0}: Error finding container 6a0c4ca106bc56afa3e3da93e1f41a87958b63a6496679de092ac85186d24637: Status 404 returned error can't find the container with id 6a0c4ca106bc56afa3e3da93e1f41a87958b63a6496679de092ac85186d24637
Sep 19 15:34:34.732435 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.732409    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7" event={"ID":"58b650c0-044b-4468-ae34-7ca78aa2e890","Type":"ContainerStarted","Data":"5b2a4e2c81a93c69b7e99992d974a78b21cca32e0917bdd57056064d61ceeda3"}
Sep 19 15:34:34.732590 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.732446    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7" event={"ID":"58b650c0-044b-4468-ae34-7ca78aa2e890","Type":"ContainerStarted","Data":"6a0c4ca106bc56afa3e3da93e1f41a87958b63a6496679de092ac85186d24637"}
Sep 19 15:34:34.749214 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:34.749150    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7" podStartSLOduration=0.749136418 podStartE2EDuration="749.136418ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:34:34.74700376 +0000 UTC m=+1337.910418800" watchObservedRunningTime="2026-09-19 15:34:34.749136418 +0000 UTC m=+1337.912551511"
Sep 19 15:34:35.592085 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:35.592051    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:35.655402 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:35.655372    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:35.730103 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:35.730065    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:35.830512 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:35.830479    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:36.542649 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:36.542619    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"]
Sep 19 15:34:36.568145 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:36.568103    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:42.548110 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:42.548028    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:34:44.357016 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:44.356986    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:44.357616 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:44.357029    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:44.369522 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:44.369500    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:44.805845 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:44.805820    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:34:46.250652 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:46.250623    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:47.010733 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:47.010698    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:47.532342 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:47.532312    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:51.562781 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.562729    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj" podUID="8a6255ff-7058-4b28-9fca-08874b7d9c25" containerName="main" containerID="cri-o://b353d06b45bdf7132977f0b989ebd132bc76281bae637c37efbf842991c3ecb6" gracePeriod=45
Sep 19 15:34:51.830337 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.830315    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:34:51.832434 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.832408    2562 generic.go:356] "Generic (PLEG): container finished" podID="8a6255ff-7058-4b28-9fca-08874b7d9c25" containerID="b353d06b45bdf7132977f0b989ebd132bc76281bae637c37efbf842991c3ecb6" exitCode=0
Sep 19 15:34:51.832543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.832441    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"
Sep 19 15:34:51.832543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.832493    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj" event={"ID":"8a6255ff-7058-4b28-9fca-08874b7d9c25","Type":"ContainerDied","Data":"b353d06b45bdf7132977f0b989ebd132bc76281bae637c37efbf842991c3ecb6"}
Sep 19 15:34:51.832543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.832536    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj" event={"ID":"8a6255ff-7058-4b28-9fca-08874b7d9c25","Type":"ContainerDied","Data":"36cc7e256239fc08c92706b2810227c400411484de9bbdc3e76ac97e02308a87"}
Sep 19 15:34:51.832667 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.832552    2562 scope.go:117] "RemoveContainer" containerID="b353d06b45bdf7132977f0b989ebd132bc76281bae637c37efbf842991c3ecb6"
Sep 19 15:34:51.840968 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.840953    2562 scope.go:117] "RemoveContainer" containerID="b353d06b45bdf7132977f0b989ebd132bc76281bae637c37efbf842991c3ecb6"
Sep 19 15:34:51.841210 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:34:51.841177    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b353d06b45bdf7132977f0b989ebd132bc76281bae637c37efbf842991c3ecb6\": container with ID starting with b353d06b45bdf7132977f0b989ebd132bc76281bae637c37efbf842991c3ecb6 not found: ID does not exist" containerID="b353d06b45bdf7132977f0b989ebd132bc76281bae637c37efbf842991c3ecb6"
Sep 19 15:34:51.841263 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.841217    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b353d06b45bdf7132977f0b989ebd132bc76281bae637c37efbf842991c3ecb6"} err="failed to get container status \"b353d06b45bdf7132977f0b989ebd132bc76281bae637c37efbf842991c3ecb6\": rpc error: code = NotFound desc = could not find container \"b353d06b45bdf7132977f0b989ebd132bc76281bae637c37efbf842991c3ecb6\": container with ID starting with b353d06b45bdf7132977f0b989ebd132bc76281bae637c37efbf842991c3ecb6 not found: ID does not exist"
Sep 19 15:34:51.895272 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.895241    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-tmp-dir\") pod \"8a6255ff-7058-4b28-9fca-08874b7d9c25\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") "
Sep 19 15:34:51.895401 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.895334    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-model-cache\") pod \"8a6255ff-7058-4b28-9fca-08874b7d9c25\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") "
Sep 19 15:34:51.895401 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.895370    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a6255ff-7058-4b28-9fca-08874b7d9c25-tls-certs\") pod \"8a6255ff-7058-4b28-9fca-08874b7d9c25\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") "
Sep 19 15:34:51.895401 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.895391    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hbpq\" (UniqueName: \"kubernetes.io/projected/8a6255ff-7058-4b28-9fca-08874b7d9c25-kube-api-access-9hbpq\") pod \"8a6255ff-7058-4b28-9fca-08874b7d9c25\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") "
Sep 19 15:34:51.895569 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.895444    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-home\") pod \"8a6255ff-7058-4b28-9fca-08874b7d9c25\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") "
Sep 19 15:34:51.895569 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.895463    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-dshm\") pod \"8a6255ff-7058-4b28-9fca-08874b7d9c25\" (UID: \"8a6255ff-7058-4b28-9fca-08874b7d9c25\") "
Sep 19 15:34:51.895569 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.895539    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8a6255ff-7058-4b28-9fca-08874b7d9c25" (UID: "8a6255ff-7058-4b28-9fca-08874b7d9c25"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:34:51.895715 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.895568    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-model-cache" (OuterVolumeSpecName: "model-cache") pod "8a6255ff-7058-4b28-9fca-08874b7d9c25" (UID: "8a6255ff-7058-4b28-9fca-08874b7d9c25"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:34:51.895773 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.895748    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-home" (OuterVolumeSpecName: "home") pod "8a6255ff-7058-4b28-9fca-08874b7d9c25" (UID: "8a6255ff-7058-4b28-9fca-08874b7d9c25"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:34:51.895896 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.895878    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-home\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:34:51.895951 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.895902    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-tmp-dir\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:34:51.895951 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.895917    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-model-cache\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:34:51.897673 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.897645    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a6255ff-7058-4b28-9fca-08874b7d9c25-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8a6255ff-7058-4b28-9fca-08874b7d9c25" (UID: "8a6255ff-7058-4b28-9fca-08874b7d9c25"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:34:51.897794 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.897689    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-dshm" (OuterVolumeSpecName: "dshm") pod "8a6255ff-7058-4b28-9fca-08874b7d9c25" (UID: "8a6255ff-7058-4b28-9fca-08874b7d9c25"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:34:51.897794 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.897728    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a6255ff-7058-4b28-9fca-08874b7d9c25-kube-api-access-9hbpq" (OuterVolumeSpecName: "kube-api-access-9hbpq") pod "8a6255ff-7058-4b28-9fca-08874b7d9c25" (UID: "8a6255ff-7058-4b28-9fca-08874b7d9c25"). InnerVolumeSpecName "kube-api-access-9hbpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:34:51.997131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.997105    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a6255ff-7058-4b28-9fca-08874b7d9c25-tls-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:34:51.997131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.997129    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hbpq\" (UniqueName: \"kubernetes.io/projected/8a6255ff-7058-4b28-9fca-08874b7d9c25-kube-api-access-9hbpq\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:34:51.997307 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:51.997139    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a6255ff-7058-4b28-9fca-08874b7d9c25-dshm\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:34:52.153004 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:52.152978    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"]
Sep 19 15:34:52.156222 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:52.156186    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-21d2a4/test-model-21d2a4-kserve-5545d4f8bf-r5ffj"]
Sep 19 15:34:52.576106 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:52.576056    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:52.640737 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:52.640706    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:52.770890 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:52.770859    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:52.873734 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:52.873628    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:53.344274 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:53.344248    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a6255ff-7058-4b28-9fca-08874b7d9c25" path="/var/lib/kubelet/pods/8a6255ff-7058-4b28-9fca-08874b7d9c25/volumes"
Sep 19 15:34:53.492484 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:53.492451    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:53.593227 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:53.593180    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:53.692985 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:53.692914    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:34:55.080822 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:34:55.080786    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:00.584634 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:00.584604    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:00.684602 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:00.684571    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:01.250550 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:01.250515    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:06.920932 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:06.920899    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:06.982589 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:06.982557    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:07.135587 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:07.135555    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:07.427024 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:07.426993    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:07.497086 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:07.496691    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j"]
Sep 19 15:35:07.497418 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:07.497395    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a6255ff-7058-4b28-9fca-08874b7d9c25" containerName="main"
Sep 19 15:35:07.497595 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:07.497576    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a6255ff-7058-4b28-9fca-08874b7d9c25" containerName="main"
Sep 19 15:35:07.497751 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:07.497737    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a6255ff-7058-4b28-9fca-08874b7d9c25" containerName="main"
Sep 19 15:35:07.502828 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:07.502807    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j"
Sep 19 15:35:07.505613 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:07.505596    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 15:35:07.505954 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:07.505936    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7znsl\""
Sep 19 15:35:07.520166 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:07.519149    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j"]
Sep 19 15:35:07.580047 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:07.580020    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:07.650310 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:07.650281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e22ac276-b667-45b1-bcc0-10c09158db9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j\" (UID: \"e22ac276-b667-45b1-bcc0-10c09158db9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j"
Sep 19 15:35:07.751021 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:07.750939    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e22ac276-b667-45b1-bcc0-10c09158db9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j\" (UID: \"e22ac276-b667-45b1-bcc0-10c09158db9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j"
Sep 19 15:35:07.751220 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:07.751170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:07.751586 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:07.751567    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e22ac276-b667-45b1-bcc0-10c09158db9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j\" (UID: \"e22ac276-b667-45b1-bcc0-10c09158db9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j"
Sep 19 15:35:07.822562 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:07.822529    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j"
Sep 19 15:35:08.094746 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:08.094695    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j"]
Sep 19 15:35:08.097634 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:35:08.097607    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode22ac276_b667_45b1_bcc0_10c09158db9d.slice/crio-78b650e61810ede871496ea9b31ea5bcf442df5af70cd6ca3bc740615a9f1241 WatchSource:0}: Error finding container 78b650e61810ede871496ea9b31ea5bcf442df5af70cd6ca3bc740615a9f1241: Status 404 returned error can't find the container with id 78b650e61810ede871496ea9b31ea5bcf442df5af70cd6ca3bc740615a9f1241
Sep 19 15:35:08.498971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:08.498941    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:08.930845 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:08.930819    2562 generic.go:356] "Generic (PLEG): container finished" podID="e22ac276-b667-45b1-bcc0-10c09158db9d" containerID="f7f5825b80a11ddb12c7967a2e6da147894f5559329f42c758843728f00733fc" exitCode=0
Sep 19 15:35:08.930963 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:08.930899    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j" event={"ID":"e22ac276-b667-45b1-bcc0-10c09158db9d","Type":"ContainerDied","Data":"f7f5825b80a11ddb12c7967a2e6da147894f5559329f42c758843728f00733fc"}
Sep 19 15:35:08.931011 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:08.930984    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j" event={"ID":"e22ac276-b667-45b1-bcc0-10c09158db9d","Type":"ContainerStarted","Data":"78b650e61810ede871496ea9b31ea5bcf442df5af70cd6ca3bc740615a9f1241"}
Sep 19 15:35:09.373811 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:09.373779    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:09.443692 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:09.443660    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:10.052806 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:10.052771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:10.073343 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:10.073325    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j"
Sep 19 15:35:10.174520 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:10.174439    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e22ac276-b667-45b1-bcc0-10c09158db9d-maas-api-service-ca\") pod \"e22ac276-b667-45b1-bcc0-10c09158db9d\" (UID: \"e22ac276-b667-45b1-bcc0-10c09158db9d\") "
Sep 19 15:35:10.174769 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:10.174746    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e22ac276-b667-45b1-bcc0-10c09158db9d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e22ac276-b667-45b1-bcc0-10c09158db9d" (UID: "e22ac276-b667-45b1-bcc0-10c09158db9d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:35:10.275554 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:10.275530    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e22ac276-b667-45b1-bcc0-10c09158db9d-maas-api-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:10.383745 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:10.383670    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:10.482783 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:10.482708    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:10.934939 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:10.934902    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:10.943689 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:10.943663    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j" event={"ID":"e22ac276-b667-45b1-bcc0-10c09158db9d","Type":"ContainerDied","Data":"78b650e61810ede871496ea9b31ea5bcf442df5af70cd6ca3bc740615a9f1241"}
Sep 19 15:35:10.943852 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:10.943696    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j"
Sep 19 15:35:10.943852 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:10.943711    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78b650e61810ede871496ea9b31ea5bcf442df5af70cd6ca3bc740615a9f1241"
Sep 19 15:35:11.971849 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:11.971817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:12.739981 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:12.739945    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:12.860256 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:12.860227    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:12.960487 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:12.960459    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:13.250545 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:13.250489    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:13.341512 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:13.341476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:13.758241 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:13.758178    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:14.501746 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:14.501698    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:15.233675 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:15.233625    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:15.770557 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:15.770527    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:16.533430 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:16.533370    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:16.750166 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:16.750138    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:35:17.750618 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:17.750586    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:18.281841 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:18.281777    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:18.343920 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:18.343870    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:18.443852 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:18.443816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:18.465037 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:18.465004    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j"]
Sep 19 15:35:18.467086 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:18.467062    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-21d2a4-lfw5j"]
Sep 19 15:35:18.508078 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:18.508047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:18.803409 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:18.803375    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:19.027963 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:19.027918    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:19.344937 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:19.344911    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e22ac276-b667-45b1-bcc0-10c09158db9d" path="/var/lib/kubelet/pods/e22ac276-b667-45b1-bcc0-10c09158db9d/volumes"
Sep 19 15:35:19.828794 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:19.828761    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:20.557594 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:20.557553    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:21.259758 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:21.259719    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:21.985086 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:21.985056    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:22.652218 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:22.652170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:23.267074 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:23.267011    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:23.953485 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:23.953452    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:24.568571 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:24.568527    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:24.967636 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:24.967510    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:25.069747 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:25.069718    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:25.123496 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:25.123468    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:25.193834 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:25.193804    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"]
Sep 19 15:35:25.194076 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:25.194052    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q" podUID="da3da919-7d85-48ee-ac22-8e7e58619004" containerName="istio-proxy" containerID="cri-o://49b095064e313ea996caa4bbee47f1d69a420c445f64dce28ef4351ef2f10013" gracePeriod=30
Sep 19 15:35:25.210515 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:25.210476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:25.699040 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:25.699005    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:25.857832 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:25.857801    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:26.117743 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:26.117713    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:26.333442 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:26.333414    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:26.962939 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:26.962908    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:27.579663 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:27.579636    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:28.183966 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:28.183916    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:28.873952 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:28.873919    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:30.452551 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.452529    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:35:30.586315 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.586284    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-istio-data\") pod \"da3da919-7d85-48ee-ac22-8e7e58619004\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") "
Sep 19 15:35:30.586504 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.586325    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da3da919-7d85-48ee-ac22-8e7e58619004-istio-podinfo\") pod \"da3da919-7d85-48ee-ac22-8e7e58619004\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") "
Sep 19 15:35:30.586504 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.586358    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-workload-certs\") pod \"da3da919-7d85-48ee-ac22-8e7e58619004\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") "
Sep 19 15:35:30.586504 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.586384    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87gvp\" (UniqueName: \"kubernetes.io/projected/da3da919-7d85-48ee-ac22-8e7e58619004-kube-api-access-87gvp\") pod \"da3da919-7d85-48ee-ac22-8e7e58619004\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") "
Sep 19 15:35:30.586504 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.586418    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-istio-envoy\") pod \"da3da919-7d85-48ee-ac22-8e7e58619004\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") "
Sep 19 15:35:30.586504 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.586435    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-credential-socket\") pod \"da3da919-7d85-48ee-ac22-8e7e58619004\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") "
Sep 19 15:35:30.586504 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.586471    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-workload-socket\") pod \"da3da919-7d85-48ee-ac22-8e7e58619004\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") "
Sep 19 15:35:30.586787 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.586511    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da3da919-7d85-48ee-ac22-8e7e58619004-istio-token\") pod \"da3da919-7d85-48ee-ac22-8e7e58619004\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") "
Sep 19 15:35:30.586787 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.586563    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da3da919-7d85-48ee-ac22-8e7e58619004-istiod-ca-cert\") pod \"da3da919-7d85-48ee-ac22-8e7e58619004\" (UID: \"da3da919-7d85-48ee-ac22-8e7e58619004\") "
Sep 19 15:35:30.586787 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.586589    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-istio-data" (OuterVolumeSpecName: "istio-data") pod "da3da919-7d85-48ee-ac22-8e7e58619004" (UID: "da3da919-7d85-48ee-ac22-8e7e58619004"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:35:30.587354 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.587293    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "da3da919-7d85-48ee-ac22-8e7e58619004" (UID: "da3da919-7d85-48ee-ac22-8e7e58619004"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:35:30.587497 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.587438    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da3da919-7d85-48ee-ac22-8e7e58619004-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "da3da919-7d85-48ee-ac22-8e7e58619004" (UID: "da3da919-7d85-48ee-ac22-8e7e58619004"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:35:30.588116 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.588039    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "da3da919-7d85-48ee-ac22-8e7e58619004" (UID: "da3da919-7d85-48ee-ac22-8e7e58619004"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:35:30.589033 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.588321    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "da3da919-7d85-48ee-ac22-8e7e58619004" (UID: "da3da919-7d85-48ee-ac22-8e7e58619004"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:35:30.589033 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.588772    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:30.589033 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.588793    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:30.589033 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.588807    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:30.589033 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.588828    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:30.589033 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.588841    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da3da919-7d85-48ee-ac22-8e7e58619004-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:30.597123 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.590299    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/da3da919-7d85-48ee-ac22-8e7e58619004-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "da3da919-7d85-48ee-ac22-8e7e58619004" (UID: "da3da919-7d85-48ee-ac22-8e7e58619004"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:35:30.597123 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.590506    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "da3da919-7d85-48ee-ac22-8e7e58619004" (UID: "da3da919-7d85-48ee-ac22-8e7e58619004"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:35:30.597123 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.590872    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da3da919-7d85-48ee-ac22-8e7e58619004-kube-api-access-87gvp" (OuterVolumeSpecName: "kube-api-access-87gvp") pod "da3da919-7d85-48ee-ac22-8e7e58619004" (UID: "da3da919-7d85-48ee-ac22-8e7e58619004"). InnerVolumeSpecName "kube-api-access-87gvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:35:30.597123 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.591961    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da3da919-7d85-48ee-ac22-8e7e58619004-istio-token" (OuterVolumeSpecName: "istio-token") pod "da3da919-7d85-48ee-ac22-8e7e58619004" (UID: "da3da919-7d85-48ee-ac22-8e7e58619004"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:35:30.689705 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.689667    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da3da919-7d85-48ee-ac22-8e7e58619004-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:30.689705 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.689699    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87gvp\" (UniqueName: \"kubernetes.io/projected/da3da919-7d85-48ee-ac22-8e7e58619004-kube-api-access-87gvp\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:30.689705 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.689711    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da3da919-7d85-48ee-ac22-8e7e58619004-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:30.689931 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:30.689719    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da3da919-7d85-48ee-ac22-8e7e58619004-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:31.064074 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:31.064040    2562 generic.go:356] "Generic (PLEG): container finished" podID="da3da919-7d85-48ee-ac22-8e7e58619004" containerID="49b095064e313ea996caa4bbee47f1d69a420c445f64dce28ef4351ef2f10013" exitCode=0
Sep 19 15:35:31.064286 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:31.064099    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"
Sep 19 15:35:31.064286 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:31.064124    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q" event={"ID":"da3da919-7d85-48ee-ac22-8e7e58619004","Type":"ContainerDied","Data":"49b095064e313ea996caa4bbee47f1d69a420c445f64dce28ef4351ef2f10013"}
Sep 19 15:35:31.064286 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:31.064224    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q" event={"ID":"da3da919-7d85-48ee-ac22-8e7e58619004","Type":"ContainerDied","Data":"1af1b55ecb09e5c26392613e666c455ecc1cfa3c206c1969f69f5597fe1b66d0"}
Sep 19 15:35:31.064286 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:31.064248    2562 scope.go:117] "RemoveContainer" containerID="49b095064e313ea996caa4bbee47f1d69a420c445f64dce28ef4351ef2f10013"
Sep 19 15:35:31.074053 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:31.074039    2562 scope.go:117] "RemoveContainer" containerID="82ed3898f43a2e850c794c25ac5dd52430092361779431bcad232581e25613ef"
Sep 19 15:35:31.083158 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:31.083145    2562 scope.go:117] "RemoveContainer" containerID="49b095064e313ea996caa4bbee47f1d69a420c445f64dce28ef4351ef2f10013"
Sep 19 15:35:31.083464 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:35:31.083446    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49b095064e313ea996caa4bbee47f1d69a420c445f64dce28ef4351ef2f10013\": container with ID starting with 49b095064e313ea996caa4bbee47f1d69a420c445f64dce28ef4351ef2f10013 not found: ID does not exist" containerID="49b095064e313ea996caa4bbee47f1d69a420c445f64dce28ef4351ef2f10013"
Sep 19 15:35:31.083518 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:31.083473    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49b095064e313ea996caa4bbee47f1d69a420c445f64dce28ef4351ef2f10013"} err="failed to get container status \"49b095064e313ea996caa4bbee47f1d69a420c445f64dce28ef4351ef2f10013\": rpc error: code = NotFound desc = could not find container \"49b095064e313ea996caa4bbee47f1d69a420c445f64dce28ef4351ef2f10013\": container with ID starting with 49b095064e313ea996caa4bbee47f1d69a420c445f64dce28ef4351ef2f10013 not found: ID does not exist"
Sep 19 15:35:31.083518 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:31.083488    2562 scope.go:117] "RemoveContainer" containerID="82ed3898f43a2e850c794c25ac5dd52430092361779431bcad232581e25613ef"
Sep 19 15:35:31.083743 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:35:31.083723    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82ed3898f43a2e850c794c25ac5dd52430092361779431bcad232581e25613ef\": container with ID starting with 82ed3898f43a2e850c794c25ac5dd52430092361779431bcad232581e25613ef not found: ID does not exist" containerID="82ed3898f43a2e850c794c25ac5dd52430092361779431bcad232581e25613ef"
Sep 19 15:35:31.083783 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:31.083754    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82ed3898f43a2e850c794c25ac5dd52430092361779431bcad232581e25613ef"} err="failed to get container status \"82ed3898f43a2e850c794c25ac5dd52430092361779431bcad232581e25613ef\": rpc error: code = NotFound desc = could not find container \"82ed3898f43a2e850c794c25ac5dd52430092361779431bcad232581e25613ef\": container with ID starting with 82ed3898f43a2e850c794c25ac5dd52430092361779431bcad232581e25613ef not found: ID does not exist"
Sep 19 15:35:31.085123 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:31.085106    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"]
Sep 19 15:35:31.088587 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:31.088559    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q"]
Sep 19 15:35:31.345894 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:31.345831    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da3da919-7d85-48ee-ac22-8e7e58619004" path="/var/lib/kubelet/pods/da3da919-7d85-48ee-ac22-8e7e58619004/volumes"
Sep 19 15:35:31.816049 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:31.816020    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:31.916845 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:31.916818    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:32.146563 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:32.146484    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5942927-6f7bh"]
Sep 19 15:35:32.146941 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:32.146927    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e22ac276-b667-45b1-bcc0-10c09158db9d" containerName="revoke-keys"
Sep 19 15:35:32.146982 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:32.146943    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e22ac276-b667-45b1-bcc0-10c09158db9d" containerName="revoke-keys"
Sep 19 15:35:32.146982 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:32.146961    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da3da919-7d85-48ee-ac22-8e7e58619004" containerName="istio-proxy"
Sep 19 15:35:32.146982 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:32.146971    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="da3da919-7d85-48ee-ac22-8e7e58619004" containerName="istio-proxy"
Sep 19 15:35:32.147077 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:32.147043    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="da3da919-7d85-48ee-ac22-8e7e58619004" containerName="istio-proxy"
Sep 19 15:35:32.147077 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:32.147060    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e22ac276-b667-45b1-bcc0-10c09158db9d" containerName="revoke-keys"
Sep 19 15:35:32.151743 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:32.151729    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5942927-6f7bh"
Sep 19 15:35:32.153959 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:32.153943    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7znsl\""
Sep 19 15:35:32.154049 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:32.154009    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 15:35:32.158036 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:32.158015    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5942927-6f7bh"]
Sep 19 15:35:32.285689 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:32.285657    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:32.306454 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:32.306428    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/087eb8a8-324d-4074-9379-346cb29b34e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a5942927-6f7bh\" (UID: \"087eb8a8-324d-4074-9379-346cb29b34e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5942927-6f7bh"
Sep 19 15:35:32.407787 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:32.407723    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/087eb8a8-324d-4074-9379-346cb29b34e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a5942927-6f7bh\" (UID: \"087eb8a8-324d-4074-9379-346cb29b34e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5942927-6f7bh"
Sep 19 15:35:32.408279 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:32.408261    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/087eb8a8-324d-4074-9379-346cb29b34e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a5942927-6f7bh\" (UID: \"087eb8a8-324d-4074-9379-346cb29b34e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5942927-6f7bh"
Sep 19 15:35:32.464586 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:32.464552    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5942927-6f7bh"
Sep 19 15:35:32.734652 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:32.734626    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5942927-6f7bh"]
Sep 19 15:35:32.737593 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:35:32.737566    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod087eb8a8_324d_4074_9379_346cb29b34e4.slice/crio-f4e09c0f299ab6a10cf3fe2df21be221b46eb8ffc87be4e1912ccaf108e33bd9 WatchSource:0}: Error finding container f4e09c0f299ab6a10cf3fe2df21be221b46eb8ffc87be4e1912ccaf108e33bd9: Status 404 returned error can't find the container with id f4e09c0f299ab6a10cf3fe2df21be221b46eb8ffc87be4e1912ccaf108e33bd9
Sep 19 15:35:33.078779 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:33.078747    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5942927-6f7bh" event={"ID":"087eb8a8-324d-4074-9379-346cb29b34e4","Type":"ContainerStarted","Data":"320dc7a1a706125a7e7c0af5ca28f56e8e4f1a09e0d0c6d6f28abfb16c6725e6"}
Sep 19 15:35:33.079099 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:33.078797    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5942927-6f7bh" event={"ID":"087eb8a8-324d-4074-9379-346cb29b34e4","Type":"ContainerStarted","Data":"f4e09c0f299ab6a10cf3fe2df21be221b46eb8ffc87be4e1912ccaf108e33bd9"}
Sep 19 15:35:33.093740 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:33.093685    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5942927-6f7bh" podStartSLOduration=1.093666195 podStartE2EDuration="1.093666195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:35:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:35:33.092021494 +0000 UTC m=+1396.255436535" watchObservedRunningTime="2026-09-19 15:35:33.093666195 +0000 UTC m=+1396.257081235"
Sep 19 15:35:33.156040 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:33.156012    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:33.979635 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:33.979599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:34.085558 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:34.085530    2562 generic.go:356] "Generic (PLEG): container finished" podID="087eb8a8-324d-4074-9379-346cb29b34e4" containerID="320dc7a1a706125a7e7c0af5ca28f56e8e4f1a09e0d0c6d6f28abfb16c6725e6" exitCode=0
Sep 19 15:35:34.085931 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:34.085608    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5942927-6f7bh" event={"ID":"087eb8a8-324d-4074-9379-346cb29b34e4","Type":"ContainerDied","Data":"320dc7a1a706125a7e7c0af5ca28f56e8e4f1a09e0d0c6d6f28abfb16c6725e6"}
Sep 19 15:35:34.665840 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:34.665811    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:35.230692 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:35.230668    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5942927-6f7bh"
Sep 19 15:35:35.338001 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:35.337961    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/087eb8a8-324d-4074-9379-346cb29b34e4-maas-api-service-ca\") pod \"087eb8a8-324d-4074-9379-346cb29b34e4\" (UID: \"087eb8a8-324d-4074-9379-346cb29b34e4\") "
Sep 19 15:35:35.338320 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:35.338300    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087eb8a8-324d-4074-9379-346cb29b34e4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "087eb8a8-324d-4074-9379-346cb29b34e4" (UID: "087eb8a8-324d-4074-9379-346cb29b34e4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:35:35.439729 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:35.439706    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/087eb8a8-324d-4074-9379-346cb29b34e4-maas-api-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:35.486119 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:35.486095    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:36.097638 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:36.097599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:36.100967 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:36.100945    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5942927-6f7bh"
Sep 19 15:35:36.101107 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:36.101011    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5942927-6f7bh" event={"ID":"087eb8a8-324d-4074-9379-346cb29b34e4","Type":"ContainerDied","Data":"f4e09c0f299ab6a10cf3fe2df21be221b46eb8ffc87be4e1912ccaf108e33bd9"}
Sep 19 15:35:36.101107 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:36.101058    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4e09c0f299ab6a10cf3fe2df21be221b46eb8ffc87be4e1912ccaf108e33bd9"
Sep 19 15:35:36.846560 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:36.846520    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:36.911264 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:36.911237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:36.966897 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:36.966869    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:37.052388 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:37.052360    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:37.108859 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:37.108784    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:37.386348 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:37.386276    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:38.005785 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:38.005750    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:38.812367 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:38.812337    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:39.690504 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:39.690473    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:40.295954 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:40.295920    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:42.114358 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:42.114326    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:42.178488 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:42.178454    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:42.277595 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:42.277567    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:42.307463 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:42.307428    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5942927-6f7bh"]
Sep 19 15:35:42.309892 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:42.309872    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5942927-6f7bh"]
Sep 19 15:35:42.334768 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:42.334746    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:42.654066 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:42.654031    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:42.862609 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:42.862579    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:43.344450 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:43.344421    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="087eb8a8-324d-4074-9379-346cb29b34e4" path="/var/lib/kubelet/pods/087eb8a8-324d-4074-9379-346cb29b34e4/volumes"
Sep 19 15:35:43.556187 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:43.556152    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:43.945115 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:43.945084    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:44.045101 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:44.045074    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:44.181695 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:44.181663    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"]
Sep 19 15:35:44.181927 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:44.181904    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q" podUID="27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" containerName="istio-proxy" containerID="cri-o://ea10739a4ad1a81bbc61ca73c96b6f6d50cce68ee30ca156c43bbb908b1fabe8" gracePeriod=30
Sep 19 15:35:44.206718 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:44.206655    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:44.459062 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:44.458975    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:44.740738 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:44.740645    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:45.030533 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:45.030460    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:45.138385 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:45.138355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:48.075754 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:48.075716    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:48.595318 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:48.595280    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:48.693167 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:48.693128    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:48.794586 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:48.794526    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:49.164543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.164511    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:49.264531 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.264501    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:49.404638 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.404602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:49.448259 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.448239    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:35:49.477921 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.477887    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-token\") pod \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") "
Sep 19 15:35:49.478058 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.477967    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-credential-socket\") pod \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") "
Sep 19 15:35:49.478058 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.478037    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-envoy\") pod \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") "
Sep 19 15:35:49.478161 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.478069    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gmkw\" (UniqueName: \"kubernetes.io/projected/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-kube-api-access-7gmkw\") pod \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") "
Sep 19 15:35:49.478161 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.478109    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-workload-certs\") pod \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") "
Sep 19 15:35:49.478161 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.478152    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-podinfo\") pod \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") "
Sep 19 15:35:49.478359 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.478186    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istiod-ca-cert\") pod \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") "
Sep 19 15:35:49.478359 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.478239    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-data\") pod \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") "
Sep 19 15:35:49.478359 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.478267    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-workload-socket\") pod \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\" (UID: \"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b\") "
Sep 19 15:35:49.478359 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.478327    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" (UID: "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:35:49.478743 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.478694    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:49.478743 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.478706    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" (UID: "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:35:49.478743 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.478722    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-data" (OuterVolumeSpecName: "istio-data") pod "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" (UID: "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:35:49.479071 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.478877    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" (UID: "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:35:49.479071 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.478898    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" (UID: "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:35:49.480522 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.480499    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" (UID: "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:35:49.481230 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.481167    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" (UID: "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:35:49.481230 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.481175    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-kube-api-access-7gmkw" (OuterVolumeSpecName: "kube-api-access-7gmkw") pod "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" (UID: "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b"). InnerVolumeSpecName "kube-api-access-7gmkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:35:49.481230 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.481182    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-token" (OuterVolumeSpecName: "istio-token") pod "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" (UID: "27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:35:49.580094 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.580063    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:49.580094 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.580090    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:49.580094 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.580099    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:49.580346 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.580107    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:49.580346 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.580116    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:49.580346 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.580124    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gmkw\" (UniqueName: \"kubernetes.io/projected/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-kube-api-access-7gmkw\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:49.580346 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.580132    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:49.580346 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.580141    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:35:49.694965 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.694889    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:49.789474 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.789423    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:49.933651 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:49.933621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:50.179886 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:50.179855    2562 generic.go:356] "Generic (PLEG): container finished" podID="27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" containerID="ea10739a4ad1a81bbc61ca73c96b6f6d50cce68ee30ca156c43bbb908b1fabe8" exitCode=0
Sep 19 15:35:50.180319 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:50.179912    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"
Sep 19 15:35:50.180319 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:50.179936    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q" event={"ID":"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b","Type":"ContainerDied","Data":"ea10739a4ad1a81bbc61ca73c96b6f6d50cce68ee30ca156c43bbb908b1fabe8"}
Sep 19 15:35:50.180319 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:50.179987    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q" event={"ID":"27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b","Type":"ContainerDied","Data":"267f14fbf5e7aa4a3acf4c86f22ec5bda9808926372dea2b5bec9b718292a35e"}
Sep 19 15:35:50.180319 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:50.180008    2562 scope.go:117] "RemoveContainer" containerID="ea10739a4ad1a81bbc61ca73c96b6f6d50cce68ee30ca156c43bbb908b1fabe8"
Sep 19 15:35:50.190936 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:50.190919    2562 scope.go:117] "RemoveContainer" containerID="f9824a45b77e7bd88dcb0bea197d880f7f7394fec26884b3e2bf372d716cb604"
Sep 19 15:35:50.200269 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:50.200245    2562 scope.go:117] "RemoveContainer" containerID="ea10739a4ad1a81bbc61ca73c96b6f6d50cce68ee30ca156c43bbb908b1fabe8"
Sep 19 15:35:50.200545 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:35:50.200515    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea10739a4ad1a81bbc61ca73c96b6f6d50cce68ee30ca156c43bbb908b1fabe8\": container with ID starting with ea10739a4ad1a81bbc61ca73c96b6f6d50cce68ee30ca156c43bbb908b1fabe8 not found: ID does not exist" containerID="ea10739a4ad1a81bbc61ca73c96b6f6d50cce68ee30ca156c43bbb908b1fabe8"
Sep 19 15:35:50.200664 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:50.200556    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea10739a4ad1a81bbc61ca73c96b6f6d50cce68ee30ca156c43bbb908b1fabe8"} err="failed to get container status \"ea10739a4ad1a81bbc61ca73c96b6f6d50cce68ee30ca156c43bbb908b1fabe8\": rpc error: code = NotFound desc = could not find container \"ea10739a4ad1a81bbc61ca73c96b6f6d50cce68ee30ca156c43bbb908b1fabe8\": container with ID starting with ea10739a4ad1a81bbc61ca73c96b6f6d50cce68ee30ca156c43bbb908b1fabe8 not found: ID does not exist"
Sep 19 15:35:50.200664 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:50.200579    2562 scope.go:117] "RemoveContainer" containerID="f9824a45b77e7bd88dcb0bea197d880f7f7394fec26884b3e2bf372d716cb604"
Sep 19 15:35:50.200965 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:35:50.200940    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9824a45b77e7bd88dcb0bea197d880f7f7394fec26884b3e2bf372d716cb604\": container with ID starting with f9824a45b77e7bd88dcb0bea197d880f7f7394fec26884b3e2bf372d716cb604 not found: ID does not exist" containerID="f9824a45b77e7bd88dcb0bea197d880f7f7394fec26884b3e2bf372d716cb604"
Sep 19 15:35:50.201061 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:50.201013    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9824a45b77e7bd88dcb0bea197d880f7f7394fec26884b3e2bf372d716cb604"} err="failed to get container status \"f9824a45b77e7bd88dcb0bea197d880f7f7394fec26884b3e2bf372d716cb604\": rpc error: code = NotFound desc = could not find container \"f9824a45b77e7bd88dcb0bea197d880f7f7394fec26884b3e2bf372d716cb604\": container with ID starting with f9824a45b77e7bd88dcb0bea197d880f7f7394fec26884b3e2bf372d716cb604 not found: ID does not exist"
Sep 19 15:35:50.204320 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:50.204301    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"]
Sep 19 15:35:50.206175 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:50.206145    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q"]
Sep 19 15:35:50.646170 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:50.646138    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:35:50.798686 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:50.798638    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:50.898616 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:50.898534    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:51.345464 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:51.345431    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" path="/var/lib/kubelet/pods/27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b/volumes"
Sep 19 15:35:51.367144 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:51.367114    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:51.452928 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:51.452894    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:51.756081 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:51.756000    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:52.826627 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:52.826594    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:53.556220 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:53.556170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:55.651179 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:55.651148    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:55.718813 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:55.718747    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:55.814965 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:55.814932    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:35:55.993745 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:35:55.993668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:02.399474 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.399440    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:02.448469 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.448444    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:02.556888 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.556861    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:02.816298 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.816263    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"]
Sep 19 15:36:02.816697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.816684    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da3da919-7d85-48ee-ac22-8e7e58619004" containerName="istio-proxy"
Sep 19 15:36:02.816749 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.816698    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="da3da919-7d85-48ee-ac22-8e7e58619004" containerName="istio-proxy"
Sep 19 15:36:02.816749 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.816714    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" containerName="istio-proxy"
Sep 19 15:36:02.816749 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.816719    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" containerName="istio-proxy"
Sep 19 15:36:02.816749 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.816728    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087eb8a8-324d-4074-9379-346cb29b34e4" containerName="revoke-keys"
Sep 19 15:36:02.816749 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.816733    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="087eb8a8-324d-4074-9379-346cb29b34e4" containerName="revoke-keys"
Sep 19 15:36:02.816749 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.816747    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" containerName="istio-proxy"
Sep 19 15:36:02.816936 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.816756    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" containerName="istio-proxy"
Sep 19 15:36:02.816936 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.816825    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="da3da919-7d85-48ee-ac22-8e7e58619004" containerName="istio-proxy"
Sep 19 15:36:02.816936 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.816836    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" containerName="istio-proxy"
Sep 19 15:36:02.816936 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.816842    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="087eb8a8-324d-4074-9379-346cb29b34e4" containerName="revoke-keys"
Sep 19 15:36:02.816936 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.816853    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="27e6ef0d-cba0-4fe1-b9ce-3c4ec689a10b" containerName="istio-proxy"
Sep 19 15:36:02.821766 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.821737    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:02.823975 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.823956    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w1-c8e1cf-openshift-default-dockercfg-nvgp6\""
Sep 19 15:36:02.831156 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.831136    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"]
Sep 19 15:36:02.841468 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.841448    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:02.903622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.903587    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-workload-socket\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:02.903768 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.903641    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istiod-ca-cert\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:02.903768 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.903673    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-workload-certs\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:02.903768 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.903696    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-envoy\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:02.903768 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.903728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-podinfo\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:02.903906 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.903831    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-credential-socket\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:02.903906 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.903861    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9cmc\" (UniqueName: \"kubernetes.io/projected/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-kube-api-access-c9cmc\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:02.903973 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.903926    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-token\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:02.904007 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:02.903973    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-data\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.005589 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.005546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-token\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.005589 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.005595    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-data\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.005839 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.005667    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-workload-socket\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.005839 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.005797    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istiod-ca-cert\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.005945 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.005854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-workload-certs\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.005945 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.005883    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-envoy\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.005945 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.005914    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-podinfo\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.006079 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.006005    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-credential-socket\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.006344 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.006319    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9cmc\" (UniqueName: \"kubernetes.io/projected/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-kube-api-access-c9cmc\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.006641 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.006611    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-workload-certs\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.006724 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.006459    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-workload-socket\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.006880 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.006856    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-data\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.012644 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.007248    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istiod-ca-cert\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.012644 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.007621    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-credential-socket\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.012644 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.009036    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-envoy\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.015823 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.013323    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-token\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.016767 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.016738    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-podinfo\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.016862 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.016786    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9cmc\" (UniqueName: \"kubernetes.io/projected/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-kube-api-access-c9cmc\") pod \"e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") " pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.133657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.133575    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:03.407799 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.407773    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"]
Sep 19 15:36:03.409276 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:36:03.409246    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec8fa88e_ee5d_40ed_b0f7_f678c3a9df7d.slice/crio-1ad1e28aaa92b3f61ae89635e7f02fc0334993913a651786a4d1efa3498ee9ae WatchSource:0}: Error finding container 1ad1e28aaa92b3f61ae89635e7f02fc0334993913a651786a4d1efa3498ee9ae: Status 404 returned error can't find the container with id 1ad1e28aaa92b3f61ae89635e7f02fc0334993913a651786a4d1efa3498ee9ae
Sep 19 15:36:03.411948 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.411919    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:36:03.412017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.411980    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:36:03.412017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.412011    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:36:03.423478 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:03.423454    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:04.257223 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:04.257175    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9" event={"ID":"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d","Type":"ContainerStarted","Data":"d62c224fd08864dd2fc88f278ed950d06720a7341da803075d240eef7df0bb50"}
Sep 19 15:36:04.257397 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:04.257247    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9" event={"ID":"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d","Type":"ContainerStarted","Data":"1ad1e28aaa92b3f61ae89635e7f02fc0334993913a651786a4d1efa3498ee9ae"}
Sep 19 15:36:04.274917 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:04.274870    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9" podStartSLOduration=2.274854649 podStartE2EDuration="2.274854649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:36:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:36:04.273618625 +0000 UTC m=+1427.437033667" watchObservedRunningTime="2026-09-19 15:36:04.274854649 +0000 UTC m=+1427.438269689"
Sep 19 15:36:05.134269 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:05.134239    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:05.139720 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:05.139697    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:05.262569 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:05.262544    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:05.263244 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:05.263224    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:05.456102 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:05.456026    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:06.148508 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:06.148424    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:06.278408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:06.278346    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:06.411084 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:06.410988    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:07.470168 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:07.470137    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:08.178496 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:08.178465    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:08.994299 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:08.994262    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:09.919261 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:09.919226    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:09.980360 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:09.980325    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:10.347131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:10.347100    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:10.448639 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:10.448612    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:10.527928 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:10.527891    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:10.985150 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:10.985102    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:11.786607 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:11.786569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:12.529967 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:12.529928    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:13.175663 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:13.175637    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:13.508611 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:13.508532    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:13.820156 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:13.820122    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:13.977939 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:13.977909    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:14.142726 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:14.142630    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:14.378710 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:14.378670    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:14.764415 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:14.764363    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:15.464758 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:15.464691    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:16.283951 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:16.283856    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:16.551258 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:16.551142    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:36:16.994460 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:16.994352    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:17.082896 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:17.082861    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:17.879274 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:17.879226    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:18.896804 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:18.896761    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:19.793433 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:19.793345    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:20.687162 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:20.687126    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:20.786540 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:20.786512    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:20.886712 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:20.886683    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:20.987305 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:20.987179    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:21.149962 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.149929    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:21.334586 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.334557    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:21.419651 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.419597    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:21.421149 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.421125    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"]
Sep 19 15:36:21.426320 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.426301    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.428647 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.428626    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w1-da587f-openshift-default-dockercfg-l5xtn\""
Sep 19 15:36:21.438590 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.438559    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"]
Sep 19 15:36:21.518801 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.518765    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:21.522030 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.522010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-token\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.522161 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.522047    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-workload-socket\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.522249 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.522155    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-podinfo\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.522312 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.522261    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-credential-socket\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.522312 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.522290    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9k2h\" (UniqueName: \"kubernetes.io/projected/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-kube-api-access-p9k2h\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.522418 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.522346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-data\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.522418 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.522390    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-workload-certs\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.522527 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.522422    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istiod-ca-cert\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.522527 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.522458    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-envoy\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.612773 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.612681    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:21.623372 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.623349    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-credential-socket\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.623512 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.623377    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9k2h\" (UniqueName: \"kubernetes.io/projected/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-kube-api-access-p9k2h\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.623512 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.623409    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-data\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.623607 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.623531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-workload-certs\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.623607 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.623572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istiod-ca-cert\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.623711 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.623615    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-envoy\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.623711 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.623655    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-token\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.623711 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.623702    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-workload-socket\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.623873 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.623798    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-data\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.623873 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.623806    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-podinfo\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.623873 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.623863    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-credential-socket\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.624037 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.623979    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-workload-certs\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.624241 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.624221    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istiod-ca-cert\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.624322 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.624227    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-workload-socket\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.626034 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.626013    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-envoy\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.626405 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.626389    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-podinfo\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.631816 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.631782    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-token\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.632228 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.632190    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9k2h\" (UniqueName: \"kubernetes.io/projected/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-kube-api-access-p9k2h\") pod \"e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") " pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.738924 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.738885    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:21.818348 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:21.813759    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:22.040653 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:22.040624    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"]
Sep 19 15:36:22.042302 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:36:22.042276    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee5c886_e1ba_47c2_8b38_7cce30711a5b.slice/crio-9ee7af43d617d2f9ecbec056c4534d52da1bbecac0c2e034b70dced378df804b WatchSource:0}: Error finding container 9ee7af43d617d2f9ecbec056c4534d52da1bbecac0c2e034b70dced378df804b: Status 404 returned error can't find the container with id 9ee7af43d617d2f9ecbec056c4534d52da1bbecac0c2e034b70dced378df804b
Sep 19 15:36:22.044798 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:22.044765    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:36:22.044915 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:22.044837    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:36:22.044915 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:22.044866    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:36:22.364214 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:22.364099    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf" event={"ID":"5ee5c886-e1ba-47c2-8b38-7cce30711a5b","Type":"ContainerStarted","Data":"41a60baf897b30a3c1680977303e85c586c176b6142072bf9b95163a51e284ad"}
Sep 19 15:36:22.364214 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:22.364151    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf" event={"ID":"5ee5c886-e1ba-47c2-8b38-7cce30711a5b","Type":"ContainerStarted","Data":"9ee7af43d617d2f9ecbec056c4534d52da1bbecac0c2e034b70dced378df804b"}
Sep 19 15:36:22.384088 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:22.384022    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf" podStartSLOduration=1.38400096 podStartE2EDuration="1.38400096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:36:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:36:22.382273135 +0000 UTC m=+1445.545688178" watchObservedRunningTime="2026-09-19 15:36:22.38400096 +0000 UTC m=+1445.547416001"
Sep 19 15:36:22.739925 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:22.739846    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:22.748128 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:22.748090    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:23.341511 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:23.341481    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:23.744429 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:23.744350    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:24.145872 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:24.145832    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:24.253094 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:24.253066    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:24.356106 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:24.356077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:24.381873 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:24.381843    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:24.382833 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:24.382813    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:24.880526 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:24.880496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:25.818238 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:25.818189    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:26.468128 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:26.468093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:26.567492 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:26.567459    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:26.694503 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:26.694478    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:26.899880 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:26.899831    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:26.987938 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:26.987850    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:27.247639 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:27.247612    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:27.404835 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:27.404801    2562 generic.go:356] "Generic (PLEG): container finished" podID="ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" containerID="d62c224fd08864dd2fc88f278ed950d06720a7341da803075d240eef7df0bb50" exitCode=0
Sep 19 15:36:27.405022 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:27.404932    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9" event={"ID":"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d","Type":"ContainerDied","Data":"d62c224fd08864dd2fc88f278ed950d06720a7341da803075d240eef7df0bb50"}
Sep 19 15:36:27.405404 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:27.405384    2562 scope.go:117] "RemoveContainer" containerID="d62c224fd08864dd2fc88f278ed950d06720a7341da803075d240eef7df0bb50"
Sep 19 15:36:27.406751 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:27.406721    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:36:27.406830 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:27.406796    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:36:27.406869 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:27.406856    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:36:27.962518 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:27.962487    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:28.416712 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:28.416672    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9" event={"ID":"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d","Type":"ContainerStarted","Data":"81730fe2c13cbaf626879c9995908ad2c972bc5bb337c5c11a5261d9ea85d315"}
Sep 19 15:36:28.475635 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:28.475603    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:28.771716 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:28.771632    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:29.080550 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:29.080522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:29.134276 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:29.134238    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:29.134544 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:29.134520    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 19 15:36:29.134602 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:29.134580    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9" podUID="ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 19 15:36:29.820599 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:29.820560    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:30.134178 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:30.134094    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 19 15:36:30.134178 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:30.134149    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9" podUID="ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 19 15:36:30.452614 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:30.452530    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:31.134520 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:31.134491    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 19 15:36:31.134898 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:31.134565    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9" podUID="ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 19 15:36:31.172496 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:31.172464    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:31.574989 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:31.574960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:31.780282 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:31.780253    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:32.134222 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:32.134173    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 19 15:36:32.134401 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:32.134248    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9" podUID="ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 19 15:36:32.616035 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:32.616010    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:33.133974 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:33.133940    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 19 15:36:33.134151 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:33.133994    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9" podUID="ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 19 15:36:33.516564 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:33.516475    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:34.138573 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:34.138531    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:34.139016 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:34.138934    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:34.139698 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:34.139682    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:36:34.272507 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:34.272474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:35.057533 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:35.057502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:35.763471 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:35.763441    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:36.418472 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:36.418443    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:37.061214 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:37.061158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:37.770761 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:37.770726    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:38.401959 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:38.401931    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:38.984932 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:38.984901    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:39.087481 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:39.087436    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:39.656021 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:39.655995    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:39.726433 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:39.726400    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9289-65ad67"]
Sep 19 15:36:39.729325 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:39.729303    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9289-65ad67"
Sep 19 15:36:39.731542 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:39.731525    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hj4r7\""
Sep 19 15:36:39.736571 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:39.736547    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9289-65ad67"]
Sep 19 15:36:39.829222 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:39.829176    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8fzs\" (UniqueName: \"kubernetes.io/projected/675bde1d-bf86-49d6-9d46-e2a4e9add1dd-kube-api-access-w8fzs\") pod \"test-curl-9289-65ad67\" (UID: \"675bde1d-bf86-49d6-9d46-e2a4e9add1dd\") " pod="opendatahub/test-curl-9289-65ad67"
Sep 19 15:36:39.929922 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:39.929844    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8fzs\" (UniqueName: \"kubernetes.io/projected/675bde1d-bf86-49d6-9d46-e2a4e9add1dd-kube-api-access-w8fzs\") pod \"test-curl-9289-65ad67\" (UID: \"675bde1d-bf86-49d6-9d46-e2a4e9add1dd\") " pod="opendatahub/test-curl-9289-65ad67"
Sep 19 15:36:39.938347 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:39.938319    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8fzs\" (UniqueName: \"kubernetes.io/projected/675bde1d-bf86-49d6-9d46-e2a4e9add1dd-kube-api-access-w8fzs\") pod \"test-curl-9289-65ad67\" (UID: \"675bde1d-bf86-49d6-9d46-e2a4e9add1dd\") " pod="opendatahub/test-curl-9289-65ad67"
Sep 19 15:36:40.040068 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:40.040037    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9289-65ad67"
Sep 19 15:36:40.308660 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:40.308627    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9289-65ad67"]
Sep 19 15:36:40.310660 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:36:40.310629    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod675bde1d_bf86_49d6_9d46_e2a4e9add1dd.slice/crio-ef0162765b54880d4953928142c8fb56bb8d039990448b8064cb9254e4da5218 WatchSource:0}: Error finding container ef0162765b54880d4953928142c8fb56bb8d039990448b8064cb9254e4da5218: Status 404 returned error can't find the container with id ef0162765b54880d4953928142c8fb56bb8d039990448b8064cb9254e4da5218
Sep 19 15:36:40.490774 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:40.490735    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9289-65ad67" event={"ID":"675bde1d-bf86-49d6-9d46-e2a4e9add1dd","Type":"ContainerStarted","Data":"6b0e4308acf2317ba2d9981dc09d4e5d1b07eda243bcb0d6d2f67816ad45a0e5"}
Sep 19 15:36:40.490946 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:40.490788    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9289-65ad67" event={"ID":"675bde1d-bf86-49d6-9d46-e2a4e9add1dd","Type":"ContainerStarted","Data":"ef0162765b54880d4953928142c8fb56bb8d039990448b8064cb9254e4da5218"}
Sep 19 15:36:40.504453 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:40.504409    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-9289-65ad67" podStartSLOduration=1.504390877 podStartE2EDuration="1.504390877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:36:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:36:40.502989151 +0000 UTC m=+1463.666404190" watchObservedRunningTime="2026-09-19 15:36:40.504390877 +0000 UTC m=+1463.667805917"
Sep 19 15:36:40.562369 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:40.562297    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:41.123419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:41.123385    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9289-65ad67"]
Sep 19 15:36:41.127184 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:41.127149    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9289-65ad67"]
Sep 19 15:36:41.237993 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:41.237671    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9289-976383"]
Sep 19 15:36:41.238392 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:41.238364    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="675bde1d-bf86-49d6-9d46-e2a4e9add1dd" containerName="test-curl-9289-65ad67"
Sep 19 15:36:41.238392 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:41.238391    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="675bde1d-bf86-49d6-9d46-e2a4e9add1dd" containerName="test-curl-9289-65ad67"
Sep 19 15:36:41.238584 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:41.238506    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="675bde1d-bf86-49d6-9d46-e2a4e9add1dd" containerName="test-curl-9289-65ad67"
Sep 19 15:36:41.240882 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:41.240862    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9289-976383"
Sep 19 15:36:41.246375 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:41.246353    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9289-976383"]
Sep 19 15:36:41.350519 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:41.350477    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxfjd\" (UniqueName: \"kubernetes.io/projected/e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e-kube-api-access-kxfjd\") pod \"test-curl-9289-976383\" (UID: \"e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e\") " pod="opendatahub/test-curl-9289-976383"
Sep 19 15:36:41.451895 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:41.451854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxfjd\" (UniqueName: \"kubernetes.io/projected/e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e-kube-api-access-kxfjd\") pod \"test-curl-9289-976383\" (UID: \"e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e\") " pod="opendatahub/test-curl-9289-976383"
Sep 19 15:36:41.459906 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:41.459881    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxfjd\" (UniqueName: \"kubernetes.io/projected/e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e-kube-api-access-kxfjd\") pod \"test-curl-9289-976383\" (UID: \"e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e\") " pod="opendatahub/test-curl-9289-976383"
Sep 19 15:36:41.500046 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:36:41.499709    2562 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-9289-65ad67" container="test-curl-9289-65ad67"
Sep 19 15:36:41.552858 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:41.552824    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9289-976383"
Sep 19 15:36:41.850731 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:41.850704    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9289-976383"]
Sep 19 15:36:41.852438 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:36:41.852410    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5f7d5c2_9635_4ea6_a8c6_b65b6042ee5e.slice/crio-430c0e0bedec188e8b0f0c4abad24b4224fd9da6c5010255206055de2b6ddcb9 WatchSource:0}: Error finding container 430c0e0bedec188e8b0f0c4abad24b4224fd9da6c5010255206055de2b6ddcb9: Status 404 returned error can't find the container with id 430c0e0bedec188e8b0f0c4abad24b4224fd9da6c5010255206055de2b6ddcb9
Sep 19 15:36:42.512530 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:42.512482    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-9289-65ad67" podUID="675bde1d-bf86-49d6-9d46-e2a4e9add1dd" containerName="test-curl-9289-65ad67" containerID="cri-o://6b0e4308acf2317ba2d9981dc09d4e5d1b07eda243bcb0d6d2f67816ad45a0e5" gracePeriod=2
Sep 19 15:36:42.513115 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:42.513084    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9289-976383" event={"ID":"e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e","Type":"ContainerStarted","Data":"487390f4e1784679682a5cfb5d39243c00a78df950a0f068372d773ff29edc38"}
Sep 19 15:36:42.513239 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:42.513135    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9289-976383" event={"ID":"e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e","Type":"ContainerStarted","Data":"430c0e0bedec188e8b0f0c4abad24b4224fd9da6c5010255206055de2b6ddcb9"}
Sep 19 15:36:42.527514 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:42.527474    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-9289-976383" podStartSLOduration=1.5274611660000001 podStartE2EDuration="1.527461166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:36:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:36:42.525578369 +0000 UTC m=+1465.688993403" watchObservedRunningTime="2026-09-19 15:36:42.527461166 +0000 UTC m=+1465.690876206"
Sep 19 15:36:43.179244 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:43.179153    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9289-976383"]
Sep 19 15:36:43.185941 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:43.185913    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9289-976383"]
Sep 19 15:36:43.302429 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:43.302395    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9289-5bb48d"]
Sep 19 15:36:43.308683 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:43.308658    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e" containerName="test-curl-9289-976383"
Sep 19 15:36:43.308840 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:43.308827    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e" containerName="test-curl-9289-976383"
Sep 19 15:36:43.309211 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:43.309176    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e" containerName="test-curl-9289-976383"
Sep 19 15:36:43.315794 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:43.315774    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9289-5bb48d"]
Sep 19 15:36:43.316028 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:43.316011    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9289-5bb48d"
Sep 19 15:36:43.371567 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:43.371543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnc8l\" (UniqueName: \"kubernetes.io/projected/32ec0ebf-9091-43e5-bcd8-2aaef5fa138d-kube-api-access-gnc8l\") pod \"test-curl-9289-5bb48d\" (UID: \"32ec0ebf-9091-43e5-bcd8-2aaef5fa138d\") " pod="opendatahub/test-curl-9289-5bb48d"
Sep 19 15:36:43.472647 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:43.472572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnc8l\" (UniqueName: \"kubernetes.io/projected/32ec0ebf-9091-43e5-bcd8-2aaef5fa138d-kube-api-access-gnc8l\") pod \"test-curl-9289-5bb48d\" (UID: \"32ec0ebf-9091-43e5-bcd8-2aaef5fa138d\") " pod="opendatahub/test-curl-9289-5bb48d"
Sep 19 15:36:43.482349 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:43.482329    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnc8l\" (UniqueName: \"kubernetes.io/projected/32ec0ebf-9091-43e5-bcd8-2aaef5fa138d-kube-api-access-gnc8l\") pod \"test-curl-9289-5bb48d\" (UID: \"32ec0ebf-9091-43e5-bcd8-2aaef5fa138d\") " pod="opendatahub/test-curl-9289-5bb48d"
Sep 19 15:36:43.519381 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:36:43.519360    2562 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-9289-976383" container="test-curl-9289-976383"
Sep 19 15:36:43.629706 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:43.629676    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9289-5bb48d"
Sep 19 15:36:43.906466 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:43.906424    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9289-5bb48d"]
Sep 19 15:36:43.912549 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:36:43.912499    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32ec0ebf_9091_43e5_bcd8_2aaef5fa138d.slice/crio-53569cb99e2fa452e859806b9ac74b03f9ab47cc4ae0371a742a5ee50b461c1a WatchSource:0}: Error finding container 53569cb99e2fa452e859806b9ac74b03f9ab47cc4ae0371a742a5ee50b461c1a: Status 404 returned error can't find the container with id 53569cb99e2fa452e859806b9ac74b03f9ab47cc4ae0371a742a5ee50b461c1a
Sep 19 15:36:44.526989 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:44.526963    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9289-5bb48d" event={"ID":"32ec0ebf-9091-43e5-bcd8-2aaef5fa138d","Type":"ContainerStarted","Data":"911f65e9cac73da678e6d26266a3df2e2a31f057a9e4e4ad29f79fd3c1efcc8f"}
Sep 19 15:36:44.527384 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:44.527002    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9289-5bb48d" event={"ID":"32ec0ebf-9091-43e5-bcd8-2aaef5fa138d","Type":"ContainerStarted","Data":"53569cb99e2fa452e859806b9ac74b03f9ab47cc4ae0371a742a5ee50b461c1a"}
Sep 19 15:36:44.527384 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:44.527231    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-9289-976383" podUID="e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e" containerName="test-curl-9289-976383" containerID="cri-o://487390f4e1784679682a5cfb5d39243c00a78df950a0f068372d773ff29edc38" gracePeriod=2
Sep 19 15:36:44.543009 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:44.542947    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-9289-5bb48d" podStartSLOduration=1.54293361 podStartE2EDuration="1.54293361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:36:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:36:44.542170828 +0000 UTC m=+1467.705585868" watchObservedRunningTime="2026-09-19 15:36:44.54293361 +0000 UTC m=+1467.706348649"
Sep 19 15:36:44.752943 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:44.752923    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9289-65ad67"
Sep 19 15:36:44.784941 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:44.784917    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8fzs\" (UniqueName: \"kubernetes.io/projected/675bde1d-bf86-49d6-9d46-e2a4e9add1dd-kube-api-access-w8fzs\") pod \"675bde1d-bf86-49d6-9d46-e2a4e9add1dd\" (UID: \"675bde1d-bf86-49d6-9d46-e2a4e9add1dd\") "
Sep 19 15:36:44.786909 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:44.786884    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/675bde1d-bf86-49d6-9d46-e2a4e9add1dd-kube-api-access-w8fzs" (OuterVolumeSpecName: "kube-api-access-w8fzs") pod "675bde1d-bf86-49d6-9d46-e2a4e9add1dd" (UID: "675bde1d-bf86-49d6-9d46-e2a4e9add1dd"). InnerVolumeSpecName "kube-api-access-w8fzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:36:44.886619 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:44.886596    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8fzs\" (UniqueName: \"kubernetes.io/projected/675bde1d-bf86-49d6-9d46-e2a4e9add1dd-kube-api-access-w8fzs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:36:45.170274 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.170185    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9289-5bb48d"]
Sep 19 15:36:45.174883 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.174859    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9289-5bb48d"]
Sep 19 15:36:45.300228 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.298065    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9289-387e6d"]
Sep 19 15:36:45.300228 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.298749    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32ec0ebf-9091-43e5-bcd8-2aaef5fa138d" containerName="test-curl-9289-5bb48d"
Sep 19 15:36:45.300228 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.298769    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="32ec0ebf-9091-43e5-bcd8-2aaef5fa138d" containerName="test-curl-9289-5bb48d"
Sep 19 15:36:45.300228 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.298875    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="32ec0ebf-9091-43e5-bcd8-2aaef5fa138d" containerName="test-curl-9289-5bb48d"
Sep 19 15:36:45.304221 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.301392    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9289-387e6d"
Sep 19 15:36:45.311793 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.310883    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9289-387e6d"]
Sep 19 15:36:45.345057 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.345025    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="675bde1d-bf86-49d6-9d46-e2a4e9add1dd" path="/var/lib/kubelet/pods/675bde1d-bf86-49d6-9d46-e2a4e9add1dd/volumes"
Sep 19 15:36:45.412798 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.412645    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-624dp\" (UniqueName: \"kubernetes.io/projected/e3192f7f-00a2-4fd4-985d-8435b49335b3-kube-api-access-624dp\") pod \"test-curl-9289-387e6d\" (UID: \"e3192f7f-00a2-4fd4-985d-8435b49335b3\") " pod="opendatahub/test-curl-9289-387e6d"
Sep 19 15:36:45.514513 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.514415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-624dp\" (UniqueName: \"kubernetes.io/projected/e3192f7f-00a2-4fd4-985d-8435b49335b3-kube-api-access-624dp\") pod \"test-curl-9289-387e6d\" (UID: \"e3192f7f-00a2-4fd4-985d-8435b49335b3\") " pod="opendatahub/test-curl-9289-387e6d"
Sep 19 15:36:45.523857 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.523180    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-624dp\" (UniqueName: \"kubernetes.io/projected/e3192f7f-00a2-4fd4-985d-8435b49335b3-kube-api-access-624dp\") pod \"test-curl-9289-387e6d\" (UID: \"e3192f7f-00a2-4fd4-985d-8435b49335b3\") " pod="opendatahub/test-curl-9289-387e6d"
Sep 19 15:36:45.534705 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.534678    2562 generic.go:356] "Generic (PLEG): container finished" podID="675bde1d-bf86-49d6-9d46-e2a4e9add1dd" containerID="6b0e4308acf2317ba2d9981dc09d4e5d1b07eda243bcb0d6d2f67816ad45a0e5" exitCode=137
Sep 19 15:36:45.535086 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.534724    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9289-65ad67"
Sep 19 15:36:45.535086 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.534745    2562 scope.go:117] "RemoveContainer" containerID="6b0e4308acf2317ba2d9981dc09d4e5d1b07eda243bcb0d6d2f67816ad45a0e5"
Sep 19 15:36:45.535086 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:36:45.535054    2562 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-9289-5bb48d" container="test-curl-9289-5bb48d"
Sep 19 15:36:45.544052 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.544035    2562 scope.go:117] "RemoveContainer" containerID="6b0e4308acf2317ba2d9981dc09d4e5d1b07eda243bcb0d6d2f67816ad45a0e5"
Sep 19 15:36:45.544405 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:36:45.544380    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b0e4308acf2317ba2d9981dc09d4e5d1b07eda243bcb0d6d2f67816ad45a0e5\": container with ID starting with 6b0e4308acf2317ba2d9981dc09d4e5d1b07eda243bcb0d6d2f67816ad45a0e5 not found: ID does not exist" containerID="6b0e4308acf2317ba2d9981dc09d4e5d1b07eda243bcb0d6d2f67816ad45a0e5"
Sep 19 15:36:45.544460 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.544418    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b0e4308acf2317ba2d9981dc09d4e5d1b07eda243bcb0d6d2f67816ad45a0e5"} err="failed to get container status \"6b0e4308acf2317ba2d9981dc09d4e5d1b07eda243bcb0d6d2f67816ad45a0e5\": rpc error: code = NotFound desc = could not find container \"6b0e4308acf2317ba2d9981dc09d4e5d1b07eda243bcb0d6d2f67816ad45a0e5\": container with ID starting with 6b0e4308acf2317ba2d9981dc09d4e5d1b07eda243bcb0d6d2f67816ad45a0e5 not found: ID does not exist"
Sep 19 15:36:45.622600 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.622557    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9289-387e6d"
Sep 19 15:36:45.892385 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:45.892347    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9289-387e6d"]
Sep 19 15:36:46.446389 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:46.446338    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:46.545176 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:46.545091    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-9289-5bb48d" podUID="32ec0ebf-9091-43e5-bcd8-2aaef5fa138d" containerName="test-curl-9289-5bb48d" containerID="cri-o://911f65e9cac73da678e6d26266a3df2e2a31f057a9e4e4ad29f79fd3c1efcc8f" gracePeriod=2
Sep 19 15:36:46.545551 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:46.545399    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9289-387e6d" event={"ID":"e3192f7f-00a2-4fd4-985d-8435b49335b3","Type":"ContainerStarted","Data":"95d6cc1e31711308e39b614a43d149e2c826ee56320262bdcfb09f56469456e3"}
Sep 19 15:36:46.545551 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:46.545435    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9289-387e6d" event={"ID":"e3192f7f-00a2-4fd4-985d-8435b49335b3","Type":"ContainerStarted","Data":"f8e3513ddbcf9ae68ff69d0a0fb92f31e92e2ad73fbfa00b83c7bd0081616a66"}
Sep 19 15:36:46.562780 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:46.562729    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-9289-387e6d" podStartSLOduration=1.5627125259999999 podStartE2EDuration="1.562712526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:36:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:36:46.561622352 +0000 UTC m=+1469.725037398" watchObservedRunningTime="2026-09-19 15:36:46.562712526 +0000 UTC m=+1469.726127566"
Sep 19 15:36:46.668022 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:46.668000    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9289-976383"
Sep 19 15:36:46.730394 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:46.730357    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxfjd\" (UniqueName: \"kubernetes.io/projected/e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e-kube-api-access-kxfjd\") pod \"e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e\" (UID: \"e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e\") "
Sep 19 15:36:46.732584 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:46.732560    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e-kube-api-access-kxfjd" (OuterVolumeSpecName: "kube-api-access-kxfjd") pod "e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e" (UID: "e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e"). InnerVolumeSpecName "kube-api-access-kxfjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:36:46.831947 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:46.831909    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxfjd\" (UniqueName: \"kubernetes.io/projected/e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e-kube-api-access-kxfjd\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:36:47.166251 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:47.166138    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9289-387e6d"]
Sep 19 15:36:47.169004 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:47.168977    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9289-387e6d"]
Sep 19 15:36:47.345140 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:47.345102    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e" path="/var/lib/kubelet/pods/e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e/volumes"
Sep 19 15:36:47.554897 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:47.554869    2562 generic.go:356] "Generic (PLEG): container finished" podID="e5f7d5c2-9635-4ea6-a8c6-b65b6042ee5e" containerID="487390f4e1784679682a5cfb5d39243c00a78df950a0f068372d773ff29edc38" exitCode=137
Sep 19 15:36:47.555374 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:47.554948    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9289-976383"
Sep 19 15:36:47.555374 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:47.554992    2562 scope.go:117] "RemoveContainer" containerID="487390f4e1784679682a5cfb5d39243c00a78df950a0f068372d773ff29edc38"
Sep 19 15:36:47.555374 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:36:47.555171    2562 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-9289-387e6d" container="test-curl-9289-387e6d"
Sep 19 15:36:47.565885 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:47.565865    2562 scope.go:117] "RemoveContainer" containerID="487390f4e1784679682a5cfb5d39243c00a78df950a0f068372d773ff29edc38"
Sep 19 15:36:47.566262 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:36:47.566224    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"487390f4e1784679682a5cfb5d39243c00a78df950a0f068372d773ff29edc38\": container with ID starting with 487390f4e1784679682a5cfb5d39243c00a78df950a0f068372d773ff29edc38 not found: ID does not exist" containerID="487390f4e1784679682a5cfb5d39243c00a78df950a0f068372d773ff29edc38"
Sep 19 15:36:47.566381 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:47.566267    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"487390f4e1784679682a5cfb5d39243c00a78df950a0f068372d773ff29edc38"} err="failed to get container status \"487390f4e1784679682a5cfb5d39243c00a78df950a0f068372d773ff29edc38\": rpc error: code = NotFound desc = could not find container \"487390f4e1784679682a5cfb5d39243c00a78df950a0f068372d773ff29edc38\": container with ID starting with 487390f4e1784679682a5cfb5d39243c00a78df950a0f068372d773ff29edc38 not found: ID does not exist"
Sep 19 15:36:47.748349 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:47.748318    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:48.063372 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.063342    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"]
Sep 19 15:36:48.063859 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.063845    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3192f7f-00a2-4fd4-985d-8435b49335b3" containerName="test-curl-9289-387e6d"
Sep 19 15:36:48.063922 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.063862    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3192f7f-00a2-4fd4-985d-8435b49335b3" containerName="test-curl-9289-387e6d"
Sep 19 15:36:48.063959 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.063931    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3192f7f-00a2-4fd4-985d-8435b49335b3" containerName="test-curl-9289-387e6d"
Sep 19 15:36:48.066637 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.066622    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.069392 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.069370    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7cbcece2-openshift-default-dockercfg-8v2n4\""
Sep 19 15:36:48.081219 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.081177    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"]
Sep 19 15:36:48.092268 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.092243    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:48.146182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.145653    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-credential-socket\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.146182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.145714    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a70c3f47-788f-459b-9d88-712dd5385976-istio-podinfo\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.146182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.145832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-istio-data\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.146182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.145923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wjb4\" (UniqueName: \"kubernetes.io/projected/a70c3f47-788f-459b-9d88-712dd5385976-kube-api-access-6wjb4\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.146182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.145966    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-istio-envoy\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.146182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.146113    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-workload-certs\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.146182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.146186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a70c3f47-788f-459b-9d88-712dd5385976-istio-token\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.146727 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.146228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a70c3f47-788f-459b-9d88-712dd5385976-istiod-ca-cert\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.146727 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.146264    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-workload-socket\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.247400 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.247367    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-workload-certs\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.247593 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.247418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a70c3f47-788f-459b-9d88-712dd5385976-istio-token\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.247593 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.247434    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a70c3f47-788f-459b-9d88-712dd5385976-istiod-ca-cert\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.247593 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.247456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-workload-socket\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.247593 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.247495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-credential-socket\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.247593 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.247520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a70c3f47-788f-459b-9d88-712dd5385976-istio-podinfo\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.247593 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.247569    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-istio-data\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.247934 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.247624    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wjb4\" (UniqueName: \"kubernetes.io/projected/a70c3f47-788f-459b-9d88-712dd5385976-kube-api-access-6wjb4\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.247934 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.247658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-istio-envoy\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.247934 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.247882    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-workload-certs\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.248090 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.247978    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-workload-socket\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.248090 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.248014    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-istio-data\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.248188 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.248177    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-credential-socket\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.248494 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.248469    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a70c3f47-788f-459b-9d88-712dd5385976-istiod-ca-cert\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.250668 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.250642    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-istio-envoy\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.250815 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.250796    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a70c3f47-788f-459b-9d88-712dd5385976-istio-podinfo\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.256981 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.256962    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a70c3f47-788f-459b-9d88-712dd5385976-istio-token\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.257396 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.257375    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wjb4\" (UniqueName: \"kubernetes.io/projected/a70c3f47-788f-459b-9d88-712dd5385976-kube-api-access-6wjb4\") pod \"e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") " pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.378674 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.378580    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:48.563407 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.563373    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-9289-387e6d" podUID="e3192f7f-00a2-4fd4-985d-8435b49335b3" containerName="test-curl-9289-387e6d" containerID="cri-o://95d6cc1e31711308e39b614a43d149e2c826ee56320262bdcfb09f56469456e3" gracePeriod=2
Sep 19 15:36:48.626068 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.626037    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:48.664781 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.664754    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"]
Sep 19 15:36:48.666235 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:36:48.666206    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda70c3f47_788f_459b_9d88_712dd5385976.slice/crio-9d1360ea2e3a75da463fcb7cfd4061e5d0dac9a2b92779b59274f92c8f9139a3 WatchSource:0}: Error finding container 9d1360ea2e3a75da463fcb7cfd4061e5d0dac9a2b92779b59274f92c8f9139a3: Status 404 returned error can't find the container with id 9d1360ea2e3a75da463fcb7cfd4061e5d0dac9a2b92779b59274f92c8f9139a3
Sep 19 15:36:48.668881 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.668840    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:36:48.668989 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.668930    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:36:48.668989 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.668973    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:36:48.716425 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.716401    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9289-5bb48d"
Sep 19 15:36:48.754502 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.754474    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnc8l\" (UniqueName: \"kubernetes.io/projected/32ec0ebf-9091-43e5-bcd8-2aaef5fa138d-kube-api-access-gnc8l\") pod \"32ec0ebf-9091-43e5-bcd8-2aaef5fa138d\" (UID: \"32ec0ebf-9091-43e5-bcd8-2aaef5fa138d\") "
Sep 19 15:36:48.756665 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.756622    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32ec0ebf-9091-43e5-bcd8-2aaef5fa138d-kube-api-access-gnc8l" (OuterVolumeSpecName: "kube-api-access-gnc8l") pod "32ec0ebf-9091-43e5-bcd8-2aaef5fa138d" (UID: "32ec0ebf-9091-43e5-bcd8-2aaef5fa138d"). InnerVolumeSpecName "kube-api-access-gnc8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:36:48.856841 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:48.856798    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnc8l\" (UniqueName: \"kubernetes.io/projected/32ec0ebf-9091-43e5-bcd8-2aaef5fa138d-kube-api-access-gnc8l\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:36:49.345759 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:49.345725    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32ec0ebf-9091-43e5-bcd8-2aaef5fa138d" path="/var/lib/kubelet/pods/32ec0ebf-9091-43e5-bcd8-2aaef5fa138d/volumes"
Sep 19 15:36:49.570468 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:49.570435    2562 generic.go:356] "Generic (PLEG): container finished" podID="32ec0ebf-9091-43e5-bcd8-2aaef5fa138d" containerID="911f65e9cac73da678e6d26266a3df2e2a31f057a9e4e4ad29f79fd3c1efcc8f" exitCode=137
Sep 19 15:36:49.570866 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:49.570474    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9289-5bb48d"
Sep 19 15:36:49.570866 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:49.570542    2562 scope.go:117] "RemoveContainer" containerID="911f65e9cac73da678e6d26266a3df2e2a31f057a9e4e4ad29f79fd3c1efcc8f"
Sep 19 15:36:49.572776 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:49.572652    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7" event={"ID":"a70c3f47-788f-459b-9d88-712dd5385976","Type":"ContainerStarted","Data":"23129f37e6c568600ae93cf68feab71562630958c2238cd3da3d0a4cb0b16f88"}
Sep 19 15:36:49.572776 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:49.572712    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7" event={"ID":"a70c3f47-788f-459b-9d88-712dd5385976","Type":"ContainerStarted","Data":"9d1360ea2e3a75da463fcb7cfd4061e5d0dac9a2b92779b59274f92c8f9139a3"}
Sep 19 15:36:49.579718 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:49.579696    2562 scope.go:117] "RemoveContainer" containerID="911f65e9cac73da678e6d26266a3df2e2a31f057a9e4e4ad29f79fd3c1efcc8f"
Sep 19 15:36:49.579973 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:36:49.579953    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"911f65e9cac73da678e6d26266a3df2e2a31f057a9e4e4ad29f79fd3c1efcc8f\": container with ID starting with 911f65e9cac73da678e6d26266a3df2e2a31f057a9e4e4ad29f79fd3c1efcc8f not found: ID does not exist" containerID="911f65e9cac73da678e6d26266a3df2e2a31f057a9e4e4ad29f79fd3c1efcc8f"
Sep 19 15:36:49.580049 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:49.579985    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"911f65e9cac73da678e6d26266a3df2e2a31f057a9e4e4ad29f79fd3c1efcc8f"} err="failed to get container status \"911f65e9cac73da678e6d26266a3df2e2a31f057a9e4e4ad29f79fd3c1efcc8f\": rpc error: code = NotFound desc = could not find container \"911f65e9cac73da678e6d26266a3df2e2a31f057a9e4e4ad29f79fd3c1efcc8f\": container with ID starting with 911f65e9cac73da678e6d26266a3df2e2a31f057a9e4e4ad29f79fd3c1efcc8f not found: ID does not exist"
Sep 19 15:36:49.606140 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:49.606084    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7" podStartSLOduration=1.606068402 podStartE2EDuration="1.606068402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:36:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:36:49.602610252 +0000 UTC m=+1472.766025315" watchObservedRunningTime="2026-09-19 15:36:49.606068402 +0000 UTC m=+1472.769483442"
Sep 19 15:36:50.379038 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:50.378971    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:50.385134 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:50.385110    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:50.494400 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:50.494321    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:50.580367 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:50.580257    2562 generic.go:356] "Generic (PLEG): container finished" podID="5ee5c886-e1ba-47c2-8b38-7cce30711a5b" containerID="41a60baf897b30a3c1680977303e85c586c176b6142072bf9b95163a51e284ad" exitCode=0
Sep 19 15:36:50.580367 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:50.580343    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf" event={"ID":"5ee5c886-e1ba-47c2-8b38-7cce30711a5b","Type":"ContainerDied","Data":"41a60baf897b30a3c1680977303e85c586c176b6142072bf9b95163a51e284ad"}
Sep 19 15:36:50.580966 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:50.580945    2562 scope.go:117] "RemoveContainer" containerID="41a60baf897b30a3c1680977303e85c586c176b6142072bf9b95163a51e284ad"
Sep 19 15:36:50.581929 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:50.581907    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:50.582375 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:50.582343    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:36:50.582455 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:50.582433    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:36:50.582526 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:50.582498    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:36:50.582924 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:50.582907    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:36:50.743104 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:50.743083    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9289-387e6d"
Sep 19 15:36:50.778350 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:50.778285    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-624dp\" (UniqueName: \"kubernetes.io/projected/e3192f7f-00a2-4fd4-985d-8435b49335b3-kube-api-access-624dp\") pod \"e3192f7f-00a2-4fd4-985d-8435b49335b3\" (UID: \"e3192f7f-00a2-4fd4-985d-8435b49335b3\") "
Sep 19 15:36:50.780450 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:50.780425    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3192f7f-00a2-4fd4-985d-8435b49335b3-kube-api-access-624dp" (OuterVolumeSpecName: "kube-api-access-624dp") pod "e3192f7f-00a2-4fd4-985d-8435b49335b3" (UID: "e3192f7f-00a2-4fd4-985d-8435b49335b3"). InnerVolumeSpecName "kube-api-access-624dp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:36:50.879287 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:50.879253    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-624dp\" (UniqueName: \"kubernetes.io/projected/e3192f7f-00a2-4fd4-985d-8435b49335b3-kube-api-access-624dp\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:36:51.349697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:51.349659    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3192f7f-00a2-4fd4-985d-8435b49335b3" path="/var/lib/kubelet/pods/e3192f7f-00a2-4fd4-985d-8435b49335b3/volumes"
Sep 19 15:36:51.394631 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:51.394599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:51.589488 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:51.589453    2562 generic.go:356] "Generic (PLEG): container finished" podID="e3192f7f-00a2-4fd4-985d-8435b49335b3" containerID="95d6cc1e31711308e39b614a43d149e2c826ee56320262bdcfb09f56469456e3" exitCode=137
Sep 19 15:36:51.589984 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:51.589551    2562 scope.go:117] "RemoveContainer" containerID="95d6cc1e31711308e39b614a43d149e2c826ee56320262bdcfb09f56469456e3"
Sep 19 15:36:51.590218 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:51.590180    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9289-387e6d"
Sep 19 15:36:51.594699 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:51.594674    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf" event={"ID":"5ee5c886-e1ba-47c2-8b38-7cce30711a5b","Type":"ContainerStarted","Data":"5265ad4223bdae09bc71d8f0fa06c4ba79bedad3744efa7aa1a027cf6e669f3a"}
Sep 19 15:36:51.607726 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:51.607700    2562 scope.go:117] "RemoveContainer" containerID="95d6cc1e31711308e39b614a43d149e2c826ee56320262bdcfb09f56469456e3"
Sep 19 15:36:51.608369 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:36:51.608336    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95d6cc1e31711308e39b614a43d149e2c826ee56320262bdcfb09f56469456e3\": container with ID starting with 95d6cc1e31711308e39b614a43d149e2c826ee56320262bdcfb09f56469456e3 not found: ID does not exist" containerID="95d6cc1e31711308e39b614a43d149e2c826ee56320262bdcfb09f56469456e3"
Sep 19 15:36:51.608537 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:51.608510    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d6cc1e31711308e39b614a43d149e2c826ee56320262bdcfb09f56469456e3"} err="failed to get container status \"95d6cc1e31711308e39b614a43d149e2c826ee56320262bdcfb09f56469456e3\": rpc error: code = NotFound desc = could not find container \"95d6cc1e31711308e39b614a43d149e2c826ee56320262bdcfb09f56469456e3\": container with ID starting with 95d6cc1e31711308e39b614a43d149e2c826ee56320262bdcfb09f56469456e3 not found: ID does not exist"
Sep 19 15:36:51.640922 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:51.640893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:51.739926 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:51.739887    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:51.740990 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:51.740965    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 19 15:36:51.741133 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:51.741030    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf" podUID="5ee5c886-e1ba-47c2-8b38-7cce30711a5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 19 15:36:51.746616 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:51.746588    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:52.706262 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:52.706225    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:52.739959 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:52.739931    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 19 15:36:52.740111 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:52.739985    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf" podUID="5ee5c886-e1ba-47c2-8b38-7cce30711a5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 19 15:36:53.514627 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:53.514587    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:53.740270 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:53.740238    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 19 15:36:53.740653 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:53.740291    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf" podUID="5ee5c886-e1ba-47c2-8b38-7cce30711a5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 19 15:36:54.260285 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:54.260251    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:54.382000 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:54.381970    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:54.740189 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:54.740158    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 19 15:36:54.740400 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:54.740228    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf" podUID="5ee5c886-e1ba-47c2-8b38-7cce30711a5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 19 15:36:55.313068 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:55.313024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:55.739728 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:55.739631    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 19 15:36:55.739728 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:55.739700    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf" podUID="5ee5c886-e1ba-47c2-8b38-7cce30711a5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 19 15:36:56.104038 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:56.103996    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:56.739916 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:56.739875    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 19 15:36:56.740093 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:56.739949    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf" podUID="5ee5c886-e1ba-47c2-8b38-7cce30711a5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 19 15:36:56.786358 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:56.786327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:57.613733 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:57.613705    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:57.672148 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:57.672116    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:57.743622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:57.743596    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:57.744502 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:57.744481    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:36:57.851918 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:57.851886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:58.215056 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:58.215028    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:36:58.313820 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:36:58.313784    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:02.145585 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:02.145554    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:37:05.858398 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:05.858366    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:08.322631 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.322597    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"]
Sep 19 15:37:08.325780 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.325761    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.329184 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.329159    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w2-50372a\"/\"kube-root-ca.crt\""
Sep 19 15:37:08.329184 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.329171    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w2-50372a\"/\"default-dockercfg-z4wpg\""
Sep 19 15:37:08.329458 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.329210    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w2-50372a\"/\"auth-test-model-50372a-kserve-self-signed-certs\""
Sep 19 15:37:08.329458 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.329346    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w2-50372a\"/\"openshift-service-ca.crt\""
Sep 19 15:37:08.333942 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.333723    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"]
Sep 19 15:37:08.420128 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.420100    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:08.472574 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.472548    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-home\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.472757 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.472587    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-model-cache\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.472757 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.472621    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-dshm\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.472757 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.472684    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27lf4\" (UniqueName: \"kubernetes.io/projected/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-kube-api-access-27lf4\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.472757 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.472743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-tls-certs\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.472918 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.472800    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-tmp-dir\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.573543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.573465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-tls-certs\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.573543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.573515    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-tmp-dir\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.573740 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.573571    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-home\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.573740 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.573600    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-model-cache\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.573740 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.573625    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-dshm\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.573740 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.573674    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27lf4\" (UniqueName: \"kubernetes.io/projected/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-kube-api-access-27lf4\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.574006 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.573982    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-tmp-dir\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.574058 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.574015    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-home\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.574098 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.574059    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-model-cache\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.576341 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.576318    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-dshm\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.576473 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.576343    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-tls-certs\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.582014 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.581994    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27lf4\" (UniqueName: \"kubernetes.io/projected/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-kube-api-access-27lf4\") pod \"auth-test-model-50372a-kserve-76875658c5-9qzfj\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.637473 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.637445    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:08.908933 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:08.908903    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"]
Sep 19 15:37:08.909573 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:37:08.909546    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1cf2edb4_2c9e_41d1_b319_7389d8bfdf1d.slice/crio-3d19481236fe19cf67a40e420727ebbad972a1d8b53534f68ce35f6db18c0de5 WatchSource:0}: Error finding container 3d19481236fe19cf67a40e420727ebbad972a1d8b53534f68ce35f6db18c0de5: Status 404 returned error can't find the container with id 3d19481236fe19cf67a40e420727ebbad972a1d8b53534f68ce35f6db18c0de5
Sep 19 15:37:09.707021 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:09.706987    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj" event={"ID":"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d","Type":"ContainerStarted","Data":"9c8c7890f225b8bbb86406dc2b8b993d16b151d6e085f2b6149ece719193f7ee"}
Sep 19 15:37:09.707021 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:09.707024    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj" event={"ID":"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d","Type":"ContainerStarted","Data":"3d19481236fe19cf67a40e420727ebbad972a1d8b53534f68ce35f6db18c0de5"}
Sep 19 15:37:09.723230 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:09.723164    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj" podStartSLOduration=1.723149973 podStartE2EDuration="1.723149973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:37:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:37:09.721170697 +0000 UTC m=+1492.884585737" watchObservedRunningTime="2026-09-19 15:37:09.723149973 +0000 UTC m=+1492.886565060"
Sep 19 15:37:18.637573 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:18.637535    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:18.637995 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:18.637661    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:18.650713 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:18.650686    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:18.775744 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:18.775710    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:37:20.507566 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:20.507529    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:21.474338 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:21.474288    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:21.606129 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:21.606059    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:21.923763 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:21.923729    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"]
Sep 19 15:37:21.928419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:21.928403    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:21.931123 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:21.931101    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-15949d\"/\"embedding-w0-15949d-kserve-self-signed-certs\""
Sep 19 15:37:21.936344 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:21.936321    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"]
Sep 19 15:37:22.018856 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.018820    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ba1dc84-2526-41b9-803d-a431c24de64f-tls-certs\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.019027 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.018877    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-dshm\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.019027 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.018934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-home\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.019027 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.018952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-model-cache\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.019027 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.018970    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-tmp-dir\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.019169 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.019051    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwkv5\" (UniqueName: \"kubernetes.io/projected/9ba1dc84-2526-41b9-803d-a431c24de64f-kube-api-access-zwkv5\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.120176 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.120134    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-home\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.120176 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.120178    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-model-cache\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.120512 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.120230    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-tmp-dir\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.120512 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.120297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwkv5\" (UniqueName: \"kubernetes.io/projected/9ba1dc84-2526-41b9-803d-a431c24de64f-kube-api-access-zwkv5\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.120512 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.120391    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ba1dc84-2526-41b9-803d-a431c24de64f-tls-certs\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.120512 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.120457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-dshm\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.120728 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.120619    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-model-cache\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.120728 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.120641    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-tmp-dir\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.120728 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.120709    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-home\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.122840 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.122818    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-dshm\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.123036 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.123021    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ba1dc84-2526-41b9-803d-a431c24de64f-tls-certs\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.127500 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.127480    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwkv5\" (UniqueName: \"kubernetes.io/projected/9ba1dc84-2526-41b9-803d-a431c24de64f-kube-api-access-zwkv5\") pod \"embedding-w0-15949d-kserve-5548c68f7d-t48vd\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") " pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.175556 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.175474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:22.238932 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.238893    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:22.545897 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.545870    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"]
Sep 19 15:37:22.548072 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:37:22.548046    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ba1dc84_2526_41b9_803d_a431c24de64f.slice/crio-e415ee4ab6fc8ae1f2fadb463655a7d829d69b802af97a7462e9fa08322e98c8 WatchSource:0}: Error finding container e415ee4ab6fc8ae1f2fadb463655a7d829d69b802af97a7462e9fa08322e98c8: Status 404 returned error can't find the container with id e415ee4ab6fc8ae1f2fadb463655a7d829d69b802af97a7462e9fa08322e98c8
Sep 19 15:37:22.629469 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.629434    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:22.783696 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.783659    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd" event={"ID":"9ba1dc84-2526-41b9-803d-a431c24de64f","Type":"ContainerStarted","Data":"4d97966e9d6cf09e6eacec12546858c3d71c9e6745314ac6cdfffc62dc2b2e99"}
Sep 19 15:37:22.783696 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.783706    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd" event={"ID":"9ba1dc84-2526-41b9-803d-a431c24de64f","Type":"ContainerStarted","Data":"e415ee4ab6fc8ae1f2fadb463655a7d829d69b802af97a7462e9fa08322e98c8"}
Sep 19 15:37:22.813316 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.813163    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd" podStartSLOduration=1.813144534 podStartE2EDuration="1.813144534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:37:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:37:22.810639849 +0000 UTC m=+1505.974054890" watchObservedRunningTime="2026-09-19 15:37:22.813144534 +0000 UTC m=+1505.976559575"
Sep 19 15:37:22.961785 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:22.961748    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:23.656312 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:23.656283    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:24.167912 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:24.167873    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:24.892414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:24.892375    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:25.632996 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:25.632968    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:26.580926 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:26.580897    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:26.689766 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:26.689735    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-33737b-895tn"]
Sep 19 15:37:26.692253 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:26.692232    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-33737b-895tn"
Sep 19 15:37:26.694550 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:26.694527    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7znsl\""
Sep 19 15:37:26.694766 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:26.694749    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 15:37:26.716279 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:26.707169    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-33737b-895tn"]
Sep 19 15:37:26.772059 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:26.772035    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc4e2ab-1176-410d-b212-4999b599c644-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-33737b-895tn\" (UID: \"5bc4e2ab-1176-410d-b212-4999b599c644\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-33737b-895tn"
Sep 19 15:37:26.873365 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:26.873338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc4e2ab-1176-410d-b212-4999b599c644-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-33737b-895tn\" (UID: \"5bc4e2ab-1176-410d-b212-4999b599c644\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-33737b-895tn"
Sep 19 15:37:26.873925 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:26.873904    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc4e2ab-1176-410d-b212-4999b599c644-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-33737b-895tn\" (UID: \"5bc4e2ab-1176-410d-b212-4999b599c644\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-33737b-895tn"
Sep 19 15:37:26.970699 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:26.970642    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:27.003765 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:27.003740    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-33737b-895tn"
Sep 19 15:37:27.281881 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:27.281858    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-33737b-895tn"]
Sep 19 15:37:27.283842 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:37:27.283809    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc4e2ab_1176_410d_b212_4999b599c644.slice/crio-d3cd8da5fa25c901a74201f7b9196a07be36c085a352d8adb408a70f7026af6b WatchSource:0}: Error finding container d3cd8da5fa25c901a74201f7b9196a07be36c085a352d8adb408a70f7026af6b: Status 404 returned error can't find the container with id d3cd8da5fa25c901a74201f7b9196a07be36c085a352d8adb408a70f7026af6b
Sep 19 15:37:27.816395 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:27.816359    2562 generic.go:356] "Generic (PLEG): container finished" podID="a70c3f47-788f-459b-9d88-712dd5385976" containerID="23129f37e6c568600ae93cf68feab71562630958c2238cd3da3d0a4cb0b16f88" exitCode=0
Sep 19 15:37:27.816835 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:27.816444    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7" event={"ID":"a70c3f47-788f-459b-9d88-712dd5385976","Type":"ContainerDied","Data":"23129f37e6c568600ae93cf68feab71562630958c2238cd3da3d0a4cb0b16f88"}
Sep 19 15:37:27.816966 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:27.816948    2562 scope.go:117] "RemoveContainer" containerID="23129f37e6c568600ae93cf68feab71562630958c2238cd3da3d0a4cb0b16f88"
Sep 19 15:37:27.818277 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:27.818245    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:37:27.818277 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:27.818264    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-33737b-895tn" event={"ID":"5bc4e2ab-1176-410d-b212-4999b599c644","Type":"ContainerStarted","Data":"1d980965aea9ecf521c3cc8605b819ff22d5f65613e6c12f5d05988e339fbb54"}
Sep 19 15:37:27.818458 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:27.818311    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-33737b-895tn" event={"ID":"5bc4e2ab-1176-410d-b212-4999b599c644","Type":"ContainerStarted","Data":"d3cd8da5fa25c901a74201f7b9196a07be36c085a352d8adb408a70f7026af6b"}
Sep 19 15:37:27.818458 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:27.818330    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:37:27.818458 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:27.818382    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:37:27.860690 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:27.860639    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-33737b-895tn" podStartSLOduration=1.860621016 podStartE2EDuration="1.860621016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:37:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:37:27.860369921 +0000 UTC m=+1511.023784962" watchObservedRunningTime="2026-09-19 15:37:27.860621016 +0000 UTC m=+1511.024036042"
Sep 19 15:37:27.865096 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:27.865070    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:28.547728 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:28.547693    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:28.826760 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:28.826668    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7" event={"ID":"a70c3f47-788f-459b-9d88-712dd5385976","Type":"ContainerStarted","Data":"f1093a3c03c9fc4a9be844a520c216e6ab013ec7365ab717d83b958bebfa15a1"}
Sep 19 15:37:28.828300 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:28.828266    2562 generic.go:356] "Generic (PLEG): container finished" podID="5bc4e2ab-1176-410d-b212-4999b599c644" containerID="1d980965aea9ecf521c3cc8605b819ff22d5f65613e6c12f5d05988e339fbb54" exitCode=0
Sep 19 15:37:28.828416 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:28.828342    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-33737b-895tn" event={"ID":"5bc4e2ab-1176-410d-b212-4999b599c644","Type":"ContainerDied","Data":"1d980965aea9ecf521c3cc8605b819ff22d5f65613e6c12f5d05988e339fbb54"}
Sep 19 15:37:29.197247 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:29.197128    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:29.378920 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:29.378891    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:37:29.379083 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:29.379053    2562 patch_prober.go:28] interesting pod/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 19 15:37:29.379129 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:29.379100    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7" podUID="a70c3f47-788f-459b-9d88-712dd5385976" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 19 15:37:29.972649 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:29.972619    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:29.986986 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:29.986969    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-33737b-895tn"
Sep 19 15:37:30.115978 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:30.115893    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc4e2ab-1176-410d-b212-4999b599c644-maas-api-service-ca\") pod \"5bc4e2ab-1176-410d-b212-4999b599c644\" (UID: \"5bc4e2ab-1176-410d-b212-4999b599c644\") "
Sep 19 15:37:30.116292 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:30.116270    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bc4e2ab-1176-410d-b212-4999b599c644-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5bc4e2ab-1176-410d-b212-4999b599c644" (UID: "5bc4e2ab-1176-410d-b212-4999b599c644"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:37:30.217643 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:30.217602    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc4e2ab-1176-410d-b212-4999b599c644-maas-api-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:30.379632 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:30.379554    2562 patch_prober.go:28] interesting pod/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 19 15:37:30.379632 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:30.379606    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7" podUID="a70c3f47-788f-459b-9d88-712dd5385976" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 19 15:37:30.596455 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:30.596386    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:30.841947 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:30.841916    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-33737b-895tn"
Sep 19 15:37:30.842098 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:30.841951    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-33737b-895tn" event={"ID":"5bc4e2ab-1176-410d-b212-4999b599c644","Type":"ContainerDied","Data":"d3cd8da5fa25c901a74201f7b9196a07be36c085a352d8adb408a70f7026af6b"}
Sep 19 15:37:30.842098 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:30.841990    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3cd8da5fa25c901a74201f7b9196a07be36c085a352d8adb408a70f7026af6b"
Sep 19 15:37:31.228683 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:31.228553    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:31.379436 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:31.379402    2562 patch_prober.go:28] interesting pod/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 19 15:37:31.379610 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:31.379456    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7" podUID="a70c3f47-788f-459b-9d88-712dd5385976" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 19 15:37:31.569685 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:31.569653    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"]
Sep 19 15:37:31.577527 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:31.577497    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"]
Sep 19 15:37:31.635212 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:31.635167    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:32.239650 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:32.239604    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:32.240048 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:32.239672    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:32.252591 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:32.252566    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:32.379565 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:32.379530    2562 patch_prober.go:28] interesting pod/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 19 15:37:32.379741 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:32.379591    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7" podUID="a70c3f47-788f-459b-9d88-712dd5385976" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 19 15:37:32.836673 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:32.836644    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:32.864020 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:32.863998    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:37:33.379127 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:33.379092    2562 patch_prober.go:28] interesting pod/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 19 15:37:33.379546 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:33.379149    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7" podUID="a70c3f47-788f-459b-9d88-712dd5385976" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 19 15:37:34.382757 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:34.382726    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:37:34.383187 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:34.383111    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:37:34.383802 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:34.383784    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:37:39.963274 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:39.963182    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:41.944503 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:41.944472    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:37:42.381414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:42.381377    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:42.482801 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:42.482774    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:42.583792 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:42.583762    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:42.597491 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:42.597466    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-33737b-895tn"]
Sep 19 15:37:42.599523 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:42.599505    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-33737b-895tn"]
Sep 19 15:37:42.686714 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:42.686619    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:42.948717 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:42.948629    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:43.064355 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:43.064320    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:43.345440 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:43.345409    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bc4e2ab-1176-410d-b212-4999b599c644" path="/var/lib/kubelet/pods/5bc4e2ab-1176-410d-b212-4999b599c644/volumes"
Sep 19 15:37:43.767962 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:43.767877    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:44.554520 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:44.554478    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:45.375342 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:45.375314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:46.128668 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.128639    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:46.597348 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.597312    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb" podUID="1568a756-989f-4231-befe-64613b8021d9" containerName="main" containerID="cri-o://a3f433ddb3566b18569edbf6687815d7215fac7a1a2addab78eb059c4869a55d" gracePeriod=45
Sep 19 15:37:46.629060 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.629021    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2" podUID="2b2d8a6c-92e6-4a55-a424-b524bdc28fe7" containerName="main" containerID="cri-o://15e3776d6d58ebd1196d0ca18529b8a6bbb6d35da8c6f90d519f2a84c7b156f1" gracePeriod=45
Sep 19 15:37:46.737823 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.737798    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:46.894488 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.894464    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:37:46.930508 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.930484    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:37:46.943512 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.943482    2562 generic.go:356] "Generic (PLEG): container finished" podID="2b2d8a6c-92e6-4a55-a424-b524bdc28fe7" containerID="15e3776d6d58ebd1196d0ca18529b8a6bbb6d35da8c6f90d519f2a84c7b156f1" exitCode=0
Sep 19 15:37:46.943641 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.943523    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"
Sep 19 15:37:46.943641 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.943568    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2" event={"ID":"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7","Type":"ContainerDied","Data":"15e3776d6d58ebd1196d0ca18529b8a6bbb6d35da8c6f90d519f2a84c7b156f1"}
Sep 19 15:37:46.943641 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.943604    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2" event={"ID":"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7","Type":"ContainerDied","Data":"cae49ce37917886d2c770246d0c74d821c64b24a069ec22299ba1b1e156a4271"}
Sep 19 15:37:46.943641 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.943625    2562 scope.go:117] "RemoveContainer" containerID="15e3776d6d58ebd1196d0ca18529b8a6bbb6d35da8c6f90d519f2a84c7b156f1"
Sep 19 15:37:46.944999 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.944977    2562 generic.go:356] "Generic (PLEG): container finished" podID="1568a756-989f-4231-befe-64613b8021d9" containerID="a3f433ddb3566b18569edbf6687815d7215fac7a1a2addab78eb059c4869a55d" exitCode=0
Sep 19 15:37:46.945347 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.945018    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"
Sep 19 15:37:46.945347 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.945073    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb" event={"ID":"1568a756-989f-4231-befe-64613b8021d9","Type":"ContainerDied","Data":"a3f433ddb3566b18569edbf6687815d7215fac7a1a2addab78eb059c4869a55d"}
Sep 19 15:37:46.945347 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.945105    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb" event={"ID":"1568a756-989f-4231-befe-64613b8021d9","Type":"ContainerDied","Data":"6d315e76cd10b33d3b59457930afb64db1cfbfca665553139f0c4bce544a562c"}
Sep 19 15:37:46.959286 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.959264    2562 scope.go:117] "RemoveContainer" containerID="15e3776d6d58ebd1196d0ca18529b8a6bbb6d35da8c6f90d519f2a84c7b156f1"
Sep 19 15:37:46.959637 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:37:46.959618    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15e3776d6d58ebd1196d0ca18529b8a6bbb6d35da8c6f90d519f2a84c7b156f1\": container with ID starting with 15e3776d6d58ebd1196d0ca18529b8a6bbb6d35da8c6f90d519f2a84c7b156f1 not found: ID does not exist" containerID="15e3776d6d58ebd1196d0ca18529b8a6bbb6d35da8c6f90d519f2a84c7b156f1"
Sep 19 15:37:46.959746 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.959651    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15e3776d6d58ebd1196d0ca18529b8a6bbb6d35da8c6f90d519f2a84c7b156f1"} err="failed to get container status \"15e3776d6d58ebd1196d0ca18529b8a6bbb6d35da8c6f90d519f2a84c7b156f1\": rpc error: code = NotFound desc = could not find container \"15e3776d6d58ebd1196d0ca18529b8a6bbb6d35da8c6f90d519f2a84c7b156f1\": container with ID starting with 15e3776d6d58ebd1196d0ca18529b8a6bbb6d35da8c6f90d519f2a84c7b156f1 not found: ID does not exist"
Sep 19 15:37:46.959746 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.959674    2562 scope.go:117] "RemoveContainer" containerID="a3f433ddb3566b18569edbf6687815d7215fac7a1a2addab78eb059c4869a55d"
Sep 19 15:37:46.969768 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.969733    2562 scope.go:117] "RemoveContainer" containerID="a3f433ddb3566b18569edbf6687815d7215fac7a1a2addab78eb059c4869a55d"
Sep 19 15:37:46.970115 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:37:46.970088    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3f433ddb3566b18569edbf6687815d7215fac7a1a2addab78eb059c4869a55d\": container with ID starting with a3f433ddb3566b18569edbf6687815d7215fac7a1a2addab78eb059c4869a55d not found: ID does not exist" containerID="a3f433ddb3566b18569edbf6687815d7215fac7a1a2addab78eb059c4869a55d"
Sep 19 15:37:46.970170 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.970126    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3f433ddb3566b18569edbf6687815d7215fac7a1a2addab78eb059c4869a55d"} err="failed to get container status \"a3f433ddb3566b18569edbf6687815d7215fac7a1a2addab78eb059c4869a55d\": rpc error: code = NotFound desc = could not find container \"a3f433ddb3566b18569edbf6687815d7215fac7a1a2addab78eb059c4869a55d\": container with ID starting with a3f433ddb3566b18569edbf6687815d7215fac7a1a2addab78eb059c4869a55d not found: ID does not exist"
Sep 19 15:37:46.993829 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.993808    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-dshm\") pod \"1568a756-989f-4231-befe-64613b8021d9\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") "
Sep 19 15:37:46.993950 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.993865    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-model-cache\") pod \"1568a756-989f-4231-befe-64613b8021d9\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") "
Sep 19 15:37:46.993950 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.993935    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-tmp-dir\") pod \"1568a756-989f-4231-befe-64613b8021d9\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") "
Sep 19 15:37:46.994124 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.993967    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-tmp-dir\") pod \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") "
Sep 19 15:37:46.994124 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.994034    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74nbj\" (UniqueName: \"kubernetes.io/projected/1568a756-989f-4231-befe-64613b8021d9-kube-api-access-74nbj\") pod \"1568a756-989f-4231-befe-64613b8021d9\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") "
Sep 19 15:37:46.994124 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.994061    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-home\") pod \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") "
Sep 19 15:37:46.994124 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.994084    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-home\") pod \"1568a756-989f-4231-befe-64613b8021d9\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") "
Sep 19 15:37:46.994124 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.994112    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-model-cache" (OuterVolumeSpecName: "model-cache") pod "1568a756-989f-4231-befe-64613b8021d9" (UID: "1568a756-989f-4231-befe-64613b8021d9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:37:46.994411 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.994134    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4m2s\" (UniqueName: \"kubernetes.io/projected/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-kube-api-access-s4m2s\") pod \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") "
Sep 19 15:37:46.994411 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.994160    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-dshm\") pod \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") "
Sep 19 15:37:46.994411 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.994184    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1568a756-989f-4231-befe-64613b8021d9-tls-certs\") pod \"1568a756-989f-4231-befe-64613b8021d9\" (UID: \"1568a756-989f-4231-befe-64613b8021d9\") "
Sep 19 15:37:46.994411 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.994226    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1568a756-989f-4231-befe-64613b8021d9" (UID: "1568a756-989f-4231-befe-64613b8021d9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:37:46.994411 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.994248    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-tls-certs\") pod \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") "
Sep 19 15:37:46.994411 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.994302    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-model-cache\") pod \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\" (UID: \"2b2d8a6c-92e6-4a55-a424-b524bdc28fe7\") "
Sep 19 15:37:46.994411 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.994371    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-home" (OuterVolumeSpecName: "home") pod "2b2d8a6c-92e6-4a55-a424-b524bdc28fe7" (UID: "2b2d8a6c-92e6-4a55-a424-b524bdc28fe7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:37:46.994411 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.994399    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-home" (OuterVolumeSpecName: "home") pod "1568a756-989f-4231-befe-64613b8021d9" (UID: "1568a756-989f-4231-befe-64613b8021d9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:37:46.994806 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.994769    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-tmp-dir\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:46.994865 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.994774    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2b2d8a6c-92e6-4a55-a424-b524bdc28fe7" (UID: "2b2d8a6c-92e6-4a55-a424-b524bdc28fe7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:37:46.994936 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.994791    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-home\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:46.995006 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.994983    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-home\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:46.995006 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.995003    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-model-cache\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:46.995154 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.995131    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-model-cache" (OuterVolumeSpecName: "model-cache") pod "2b2d8a6c-92e6-4a55-a424-b524bdc28fe7" (UID: "2b2d8a6c-92e6-4a55-a424-b524bdc28fe7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:37:46.996755 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.996724    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-kube-api-access-s4m2s" (OuterVolumeSpecName: "kube-api-access-s4m2s") pod "2b2d8a6c-92e6-4a55-a424-b524bdc28fe7" (UID: "2b2d8a6c-92e6-4a55-a424-b524bdc28fe7"). InnerVolumeSpecName "kube-api-access-s4m2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:37:46.997182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.997157    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-dshm" (OuterVolumeSpecName: "dshm") pod "1568a756-989f-4231-befe-64613b8021d9" (UID: "1568a756-989f-4231-befe-64613b8021d9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:37:46.997327 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.997304    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-dshm" (OuterVolumeSpecName: "dshm") pod "2b2d8a6c-92e6-4a55-a424-b524bdc28fe7" (UID: "2b2d8a6c-92e6-4a55-a424-b524bdc28fe7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:37:46.997384 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.997369    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2b2d8a6c-92e6-4a55-a424-b524bdc28fe7" (UID: "2b2d8a6c-92e6-4a55-a424-b524bdc28fe7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:37:46.998167 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.998147    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1568a756-989f-4231-befe-64613b8021d9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1568a756-989f-4231-befe-64613b8021d9" (UID: "1568a756-989f-4231-befe-64613b8021d9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:37:46.998418 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:46.998399    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1568a756-989f-4231-befe-64613b8021d9-kube-api-access-74nbj" (OuterVolumeSpecName: "kube-api-access-74nbj") pod "1568a756-989f-4231-befe-64613b8021d9" (UID: "1568a756-989f-4231-befe-64613b8021d9"). InnerVolumeSpecName "kube-api-access-74nbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:37:47.096215 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:47.096160    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4m2s\" (UniqueName: \"kubernetes.io/projected/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-kube-api-access-s4m2s\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:47.096215 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:47.096190    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-dshm\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:47.096413 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:47.096225    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1568a756-989f-4231-befe-64613b8021d9-tls-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:47.096413 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:47.096235    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-tls-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:47.096413 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:47.096242    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-model-cache\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:47.096413 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:47.096251    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1568a756-989f-4231-befe-64613b8021d9-dshm\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:47.096413 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:47.096257    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7-tmp-dir\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:47.096413 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:47.096265    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74nbj\" (UniqueName: \"kubernetes.io/projected/1568a756-989f-4231-befe-64613b8021d9-kube-api-access-74nbj\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:47.267132 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:47.267103    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"]
Sep 19 15:37:47.270841 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:47.270814    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-33737b/premium-w3-33737b-kserve-568bfc5dd6-7nlr2"]
Sep 19 15:37:47.280275 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:47.280252    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"]
Sep 19 15:37:47.283604 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:47.283580    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-33737b/distinct-w3-33737b-kserve-54df58d7d5-xw5xb"]
Sep 19 15:37:47.346997 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:47.346974    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1568a756-989f-4231-befe-64613b8021d9" path="/var/lib/kubelet/pods/1568a756-989f-4231-befe-64613b8021d9/volumes"
Sep 19 15:37:47.347528 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:47.347510    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b2d8a6c-92e6-4a55-a424-b524bdc28fe7" path="/var/lib/kubelet/pods/2b2d8a6c-92e6-4a55-a424-b524bdc28fe7/volumes"
Sep 19 15:37:47.492583 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:47.492555    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:48.950094 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:48.950057    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:49.009423 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:49.009395    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:49.214912 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:49.214835    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"]
Sep 19 15:37:49.215143 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:49.215118    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf" podUID="8fdb610f-a61d-42ef-ba98-544e4b0aed49" containerName="istio-proxy" containerID="cri-o://26f138eb4991a7c707618b70ab86423b1b4fbaa355cc777c11560cdc5ed80763" gracePeriod=30
Sep 19 15:37:49.235016 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:49.234950    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:37:50.790109 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:50.790073    2562 patch_prober.go:28] interesting pod/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 15:37:50.790501 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:50.790133    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf" podUID="8fdb610f-a61d-42ef-ba98-544e4b0aed49" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 15:37:54.465379 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.465354    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:37:54.571579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.571551    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-credential-socket\") pod \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") "
Sep 19 15:37:54.571725 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.571588    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-workload-socket\") pod \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") "
Sep 19 15:37:54.571725 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.571611    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl9x9\" (UniqueName: \"kubernetes.io/projected/8fdb610f-a61d-42ef-ba98-544e4b0aed49-kube-api-access-zl9x9\") pod \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") "
Sep 19 15:37:54.571725 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.571678    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-token\") pod \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") "
Sep 19 15:37:54.571725 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.571707    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-envoy\") pod \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") "
Sep 19 15:37:54.571923 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.571825    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-data\") pod \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") "
Sep 19 15:37:54.571923 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.571846    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8fdb610f-a61d-42ef-ba98-544e4b0aed49" (UID: "8fdb610f-a61d-42ef-ba98-544e4b0aed49"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:37:54.571923 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.571867    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8fdb610f-a61d-42ef-ba98-544e4b0aed49" (UID: "8fdb610f-a61d-42ef-ba98-544e4b0aed49"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:37:54.571923 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.571889    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-podinfo\") pod \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") "
Sep 19 15:37:54.572132 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.571952    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istiod-ca-cert\") pod \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") "
Sep 19 15:37:54.572132 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.572006    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-workload-certs\") pod \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\" (UID: \"8fdb610f-a61d-42ef-ba98-544e4b0aed49\") "
Sep 19 15:37:54.572132 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.572103    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-data" (OuterVolumeSpecName: "istio-data") pod "8fdb610f-a61d-42ef-ba98-544e4b0aed49" (UID: "8fdb610f-a61d-42ef-ba98-544e4b0aed49"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:37:54.572435 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.572401    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8fdb610f-a61d-42ef-ba98-544e4b0aed49" (UID: "8fdb610f-a61d-42ef-ba98-544e4b0aed49"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:37:54.572640 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.572611    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8fdb610f-a61d-42ef-ba98-544e4b0aed49" (UID: "8fdb610f-a61d-42ef-ba98-544e4b0aed49"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:37:54.572714 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.572574    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:54.572714 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.572661    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:54.572714 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.572678    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:54.574023 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.574002    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fdb610f-a61d-42ef-ba98-544e4b0aed49-kube-api-access-zl9x9" (OuterVolumeSpecName: "kube-api-access-zl9x9") pod "8fdb610f-a61d-42ef-ba98-544e4b0aed49" (UID: "8fdb610f-a61d-42ef-ba98-544e4b0aed49"). InnerVolumeSpecName "kube-api-access-zl9x9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:37:54.574023 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.574015    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-token" (OuterVolumeSpecName: "istio-token") pod "8fdb610f-a61d-42ef-ba98-544e4b0aed49" (UID: "8fdb610f-a61d-42ef-ba98-544e4b0aed49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:37:54.574491 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.574475    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8fdb610f-a61d-42ef-ba98-544e4b0aed49" (UID: "8fdb610f-a61d-42ef-ba98-544e4b0aed49"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:37:54.574491 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.574479    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8fdb610f-a61d-42ef-ba98-544e4b0aed49" (UID: "8fdb610f-a61d-42ef-ba98-544e4b0aed49"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:37:54.673870 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.673848    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:54.673870 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.673869    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl9x9\" (UniqueName: \"kubernetes.io/projected/8fdb610f-a61d-42ef-ba98-544e4b0aed49-kube-api-access-zl9x9\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:54.674015 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.673879    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:54.674015 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.673888    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:54.674015 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.673897    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:54.674015 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.673904    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fdb610f-a61d-42ef-ba98-544e4b0aed49-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:37:54.995618 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.995519    2562 generic.go:356] "Generic (PLEG): container finished" podID="8fdb610f-a61d-42ef-ba98-544e4b0aed49" containerID="26f138eb4991a7c707618b70ab86423b1b4fbaa355cc777c11560cdc5ed80763" exitCode=0
Sep 19 15:37:54.995618 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.995571    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"
Sep 19 15:37:54.995618 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.995597    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf" event={"ID":"8fdb610f-a61d-42ef-ba98-544e4b0aed49","Type":"ContainerDied","Data":"26f138eb4991a7c707618b70ab86423b1b4fbaa355cc777c11560cdc5ed80763"}
Sep 19 15:37:54.995891 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.995659    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf" event={"ID":"8fdb610f-a61d-42ef-ba98-544e4b0aed49","Type":"ContainerDied","Data":"4995447d593196e9f3bea4e3a9f2f30f2685c73712a59e7d356a3b0dd318e5ce"}
Sep 19 15:37:54.995891 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:54.995681    2562 scope.go:117] "RemoveContainer" containerID="26f138eb4991a7c707618b70ab86423b1b4fbaa355cc777c11560cdc5ed80763"
Sep 19 15:37:55.006526 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:55.006510    2562 scope.go:117] "RemoveContainer" containerID="7181f9d16e71516d965936343274057d58d137789df061faab9b03ba97c3679a"
Sep 19 15:37:55.014688 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:55.014672    2562 scope.go:117] "RemoveContainer" containerID="26f138eb4991a7c707618b70ab86423b1b4fbaa355cc777c11560cdc5ed80763"
Sep 19 15:37:55.015001 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:37:55.014976    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26f138eb4991a7c707618b70ab86423b1b4fbaa355cc777c11560cdc5ed80763\": container with ID starting with 26f138eb4991a7c707618b70ab86423b1b4fbaa355cc777c11560cdc5ed80763 not found: ID does not exist" containerID="26f138eb4991a7c707618b70ab86423b1b4fbaa355cc777c11560cdc5ed80763"
Sep 19 15:37:55.015163 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:55.015047    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26f138eb4991a7c707618b70ab86423b1b4fbaa355cc777c11560cdc5ed80763"} err="failed to get container status \"26f138eb4991a7c707618b70ab86423b1b4fbaa355cc777c11560cdc5ed80763\": rpc error: code = NotFound desc = could not find container \"26f138eb4991a7c707618b70ab86423b1b4fbaa355cc777c11560cdc5ed80763\": container with ID starting with 26f138eb4991a7c707618b70ab86423b1b4fbaa355cc777c11560cdc5ed80763 not found: ID does not exist"
Sep 19 15:37:55.015163 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:55.015072    2562 scope.go:117] "RemoveContainer" containerID="7181f9d16e71516d965936343274057d58d137789df061faab9b03ba97c3679a"
Sep 19 15:37:55.015524 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:37:55.015442    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7181f9d16e71516d965936343274057d58d137789df061faab9b03ba97c3679a\": container with ID starting with 7181f9d16e71516d965936343274057d58d137789df061faab9b03ba97c3679a not found: ID does not exist" containerID="7181f9d16e71516d965936343274057d58d137789df061faab9b03ba97c3679a"
Sep 19 15:37:55.015524 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:55.015477    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7181f9d16e71516d965936343274057d58d137789df061faab9b03ba97c3679a"} err="failed to get container status \"7181f9d16e71516d965936343274057d58d137789df061faab9b03ba97c3679a\": rpc error: code = NotFound desc = could not find container \"7181f9d16e71516d965936343274057d58d137789df061faab9b03ba97c3679a\": container with ID starting with 7181f9d16e71516d965936343274057d58d137789df061faab9b03ba97c3679a not found: ID does not exist"
Sep 19 15:37:55.018491 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:55.018458    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"]
Sep 19 15:37:55.021221 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:55.021188    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf"]
Sep 19 15:37:55.345182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:37:55.345143    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fdb610f-a61d-42ef-ba98-544e4b0aed49" path="/var/lib/kubelet/pods/8fdb610f-a61d-42ef-ba98-544e4b0aed49/volumes"
Sep 19 15:38:08.150491 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:08.150453    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:08.205926 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:08.205876    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:09.087075 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:09.087043    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:10.237765 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:10.237694    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:17.444601 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:17.444573    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:38:40.477805 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:40.477771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:41.624631 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.624569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:41.738748 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.738716    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg"]
Sep 19 15:38:41.739133 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.739121    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fdb610f-a61d-42ef-ba98-544e4b0aed49" containerName="istio-proxy"
Sep 19 15:38:41.739182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.739135    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fdb610f-a61d-42ef-ba98-544e4b0aed49" containerName="istio-proxy"
Sep 19 15:38:41.739182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.739150    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bc4e2ab-1176-410d-b212-4999b599c644" containerName="revoke-keys"
Sep 19 15:38:41.739182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.739155    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc4e2ab-1176-410d-b212-4999b599c644" containerName="revoke-keys"
Sep 19 15:38:41.739182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.739166    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fdb610f-a61d-42ef-ba98-544e4b0aed49" containerName="istio-proxy"
Sep 19 15:38:41.739182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.739171    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fdb610f-a61d-42ef-ba98-544e4b0aed49" containerName="istio-proxy"
Sep 19 15:38:41.739182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.739180    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1568a756-989f-4231-befe-64613b8021d9" containerName="main"
Sep 19 15:38:41.739428 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.739186    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1568a756-989f-4231-befe-64613b8021d9" containerName="main"
Sep 19 15:38:41.739428 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.739207    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b2d8a6c-92e6-4a55-a424-b524bdc28fe7" containerName="main"
Sep 19 15:38:41.739428 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.739212    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b2d8a6c-92e6-4a55-a424-b524bdc28fe7" containerName="main"
Sep 19 15:38:41.739428 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.739280    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bc4e2ab-1176-410d-b212-4999b599c644" containerName="revoke-keys"
Sep 19 15:38:41.739428 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.739288    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fdb610f-a61d-42ef-ba98-544e4b0aed49" containerName="istio-proxy"
Sep 19 15:38:41.739428 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.739294    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b2d8a6c-92e6-4a55-a424-b524bdc28fe7" containerName="main"
Sep 19 15:38:41.739428 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.739302    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1568a756-989f-4231-befe-64613b8021d9" containerName="main"
Sep 19 15:38:41.744060 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.744043    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg"
Sep 19 15:38:41.746576 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.746554    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 15:38:41.747270 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.747249    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7znsl\""
Sep 19 15:38:41.749598 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.749579    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg"]
Sep 19 15:38:41.834356 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.834322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cd25cd9-062f-4f50-8e96-5cc677b06266-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg\" (UID: \"0cd25cd9-062f-4f50-8e96-5cc677b06266\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg"
Sep 19 15:38:41.935162 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.935082    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cd25cd9-062f-4f50-8e96-5cc677b06266-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg\" (UID: \"0cd25cd9-062f-4f50-8e96-5cc677b06266\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg"
Sep 19 15:38:41.935688 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:41.935671    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cd25cd9-062f-4f50-8e96-5cc677b06266-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg\" (UID: \"0cd25cd9-062f-4f50-8e96-5cc677b06266\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg"
Sep 19 15:38:42.056217 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:42.056176    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg"
Sep 19 15:38:42.067927 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:42.067903    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:42.331552 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:42.331530    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg"]
Sep 19 15:38:42.333381 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:38:42.333351    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cd25cd9_062f_4f50_8e96_5cc677b06266.slice/crio-25f3435da960d78ebb86c07627cd01072038eedf32b3bc2abc2a283cd4024897 WatchSource:0}: Error finding container 25f3435da960d78ebb86c07627cd01072038eedf32b3bc2abc2a283cd4024897: Status 404 returned error can't find the container with id 25f3435da960d78ebb86c07627cd01072038eedf32b3bc2abc2a283cd4024897
Sep 19 15:38:42.849543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:42.849451    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:43.280020 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:43.279939    2562 generic.go:356] "Generic (PLEG): container finished" podID="0cd25cd9-062f-4f50-8e96-5cc677b06266" containerID="6d2a7a640ff506a6f6c292885395ed7d2fb110d7822963cfc82e6c59313cc77a" exitCode=0
Sep 19 15:38:43.280020 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:43.279984    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg" event={"ID":"0cd25cd9-062f-4f50-8e96-5cc677b06266","Type":"ContainerDied","Data":"6d2a7a640ff506a6f6c292885395ed7d2fb110d7822963cfc82e6c59313cc77a"}
Sep 19 15:38:43.280229 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:43.280053    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg" event={"ID":"0cd25cd9-062f-4f50-8e96-5cc677b06266","Type":"ContainerStarted","Data":"25f3435da960d78ebb86c07627cd01072038eedf32b3bc2abc2a283cd4024897"}
Sep 19 15:38:43.451074 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:43.451041    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:44.063083 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:44.063054    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:44.425015 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:44.424991    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg"
Sep 19 15:38:44.568964 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:44.568934    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cd25cd9-062f-4f50-8e96-5cc677b06266-maas-api-service-ca\") pod \"0cd25cd9-062f-4f50-8e96-5cc677b06266\" (UID: \"0cd25cd9-062f-4f50-8e96-5cc677b06266\") "
Sep 19 15:38:44.569264 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:44.569245    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cd25cd9-062f-4f50-8e96-5cc677b06266-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0cd25cd9-062f-4f50-8e96-5cc677b06266" (UID: "0cd25cd9-062f-4f50-8e96-5cc677b06266"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:38:44.670484 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:44.670409    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cd25cd9-062f-4f50-8e96-5cc677b06266-maas-api-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:38:44.676261 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:44.676230    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:44.752122 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:44.750991    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:38:45.177610 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:45.177577    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:45.294383 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:45.294357    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg"
Sep 19 15:38:45.294557 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:45.294395    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg" event={"ID":"0cd25cd9-062f-4f50-8e96-5cc677b06266","Type":"ContainerDied","Data":"25f3435da960d78ebb86c07627cd01072038eedf32b3bc2abc2a283cd4024897"}
Sep 19 15:38:45.294557 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:45.294440    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25f3435da960d78ebb86c07627cd01072038eedf32b3bc2abc2a283cd4024897"
Sep 19 15:38:46.073814 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:46.073782    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:46.604630 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:46.604602    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"]
Sep 19 15:38:46.623961 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:46.623931    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"]
Sep 19 15:38:46.641247 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:46.641182    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"]
Sep 19 15:38:46.695107 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:46.695037    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:46.754132 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:46.754107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:52.886981 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:52.886947    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7"]
Sep 19 15:38:52.887419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:52.887400    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cd25cd9-062f-4f50-8e96-5cc677b06266" containerName="revoke-keys"
Sep 19 15:38:52.887419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:52.887413    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cd25cd9-062f-4f50-8e96-5cc677b06266" containerName="revoke-keys"
Sep 19 15:38:52.887501 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:52.887490    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cd25cd9-062f-4f50-8e96-5cc677b06266" containerName="revoke-keys"
Sep 19 15:38:52.887537 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:52.887506    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fdb610f-a61d-42ef-ba98-544e4b0aed49" containerName="istio-proxy"
Sep 19 15:38:52.890498 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:52.890484    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7"
Sep 19 15:38:52.892670 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:52.892644    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7znsl\""
Sep 19 15:38:52.892805 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:52.892790    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 15:38:52.897175 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:52.897149    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7"]
Sep 19 15:38:52.949580 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:52.949548    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ecf8ef4-19db-4c29-81bf-9515e9f982f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7\" (UID: \"4ecf8ef4-19db-4c29-81bf-9515e9f982f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7"
Sep 19 15:38:53.047690 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:53.047653    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:53.050642 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:53.050620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ecf8ef4-19db-4c29-81bf-9515e9f982f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7\" (UID: \"4ecf8ef4-19db-4c29-81bf-9515e9f982f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7"
Sep 19 15:38:53.051362 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:53.051345    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ecf8ef4-19db-4c29-81bf-9515e9f982f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7\" (UID: \"4ecf8ef4-19db-4c29-81bf-9515e9f982f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7"
Sep 19 15:38:53.203449 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:53.203364    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7"
Sep 19 15:38:53.477355 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:53.476589    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7"]
Sep 19 15:38:53.483760 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:38:53.483734    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ecf8ef4_19db_4c29_81bf_9515e9f982f3.slice/crio-3db7147a307f6a80078ee5948aef042ad0cd0993e02f36090325d621df6576a9 WatchSource:0}: Error finding container 3db7147a307f6a80078ee5948aef042ad0cd0993e02f36090325d621df6576a9: Status 404 returned error can't find the container with id 3db7147a307f6a80078ee5948aef042ad0cd0993e02f36090325d621df6576a9
Sep 19 15:38:53.959029 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:53.958998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:54.346008 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:54.345984    2562 generic.go:356] "Generic (PLEG): container finished" podID="4ecf8ef4-19db-4c29-81bf-9515e9f982f3" containerID="16f04f781d8d696b526579fe75763947e5b361d87fe5b8f44771d343b6d238ab" exitCode=0
Sep 19 15:38:54.346158 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:54.346028    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7" event={"ID":"4ecf8ef4-19db-4c29-81bf-9515e9f982f3","Type":"ContainerDied","Data":"16f04f781d8d696b526579fe75763947e5b361d87fe5b8f44771d343b6d238ab"}
Sep 19 15:38:54.346158 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:54.346070    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7" event={"ID":"4ecf8ef4-19db-4c29-81bf-9515e9f982f3","Type":"ContainerStarted","Data":"3db7147a307f6a80078ee5948aef042ad0cd0993e02f36090325d621df6576a9"}
Sep 19 15:38:54.656664 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:54.656588    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:55.249681 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:55.249638    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:55.499488 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:55.499465    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7"
Sep 19 15:38:55.578467 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:55.578444    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ecf8ef4-19db-4c29-81bf-9515e9f982f3-maas-api-service-ca\") pod \"4ecf8ef4-19db-4c29-81bf-9515e9f982f3\" (UID: \"4ecf8ef4-19db-4c29-81bf-9515e9f982f3\") "
Sep 19 15:38:55.578779 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:55.578756    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ecf8ef4-19db-4c29-81bf-9515e9f982f3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4ecf8ef4-19db-4c29-81bf-9515e9f982f3" (UID: "4ecf8ef4-19db-4c29-81bf-9515e9f982f3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:38:55.679385 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:55.679360    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ecf8ef4-19db-4c29-81bf-9515e9f982f3-maas-api-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:38:55.690551 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:55.690527    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:55.790954 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:55.790926    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:55.955378 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:55.955297    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:56.357848 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:56.357809    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7" event={"ID":"4ecf8ef4-19db-4c29-81bf-9515e9f982f3","Type":"ContainerDied","Data":"3db7147a307f6a80078ee5948aef042ad0cd0993e02f36090325d621df6576a9"}
Sep 19 15:38:56.358247 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:56.357854    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3db7147a307f6a80078ee5948aef042ad0cd0993e02f36090325d621df6576a9"
Sep 19 15:38:56.358247 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:56.357817    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7"
Sep 19 15:38:56.476467 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:56.476440    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:56.574466 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:56.574437    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:56.675657 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:56.675556    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:56.760326 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:56.760293    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:56.830315 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:56.830279    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg"]
Sep 19 15:38:56.831906 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:56.831844    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:56.833826 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:56.833802    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-15949d-99gkg"]
Sep 19 15:38:56.961543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:56.961445    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:57.161468 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:57.161439    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:57.344628 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:57.344598    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cd25cd9-062f-4f50-8e96-5cc677b06266" path="/var/lib/kubelet/pods/0cd25cd9-062f-4f50-8e96-5cc677b06266/volumes"
Sep 19 15:38:57.681092 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:57.680983    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:58.291132 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:58.291101    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:58.960829 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:58.960797    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:38:59.560032 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:38:59.559998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:00.283346 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:00.283314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:00.787525 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:00.787476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:01.624688 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:01.624638    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7" podUID="58b650c0-044b-4468-ae34-7ca78aa2e890" containerName="main" containerID="cri-o://5b2a4e2c81a93c69b7e99992d974a78b21cca32e0917bdd57056064d61ceeda3" gracePeriod=45
Sep 19 15:39:01.644632 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:01.644601    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd" podUID="9ba1dc84-2526-41b9-803d-a431c24de64f" containerName="main" containerID="cri-o://4d97966e9d6cf09e6eacec12546858c3d71c9e6745314ac6cdfffc62dc2b2e99" gracePeriod=45
Sep 19 15:39:01.660051 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:01.660002    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg" podUID="32cb6c46-413c-4a16-9671-4fa600a4aa7c" containerName="main" containerID="cri-o://111bd34e9aee0daa7acbc74d94e47c39efef4978a69299f74c6ec70fd9900b43" gracePeriod=45
Sep 19 15:39:01.955321 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:01.955296    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:39:01.958677 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:01.958656    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:39:01.972732 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:01.972709    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:39:02.045514 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.045488    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-home\") pod \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") "
Sep 19 15:39:02.045678 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.045526    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-dshm\") pod \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") "
Sep 19 15:39:02.045678 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.045548    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwkv5\" (UniqueName: \"kubernetes.io/projected/9ba1dc84-2526-41b9-803d-a431c24de64f-kube-api-access-zwkv5\") pod \"9ba1dc84-2526-41b9-803d-a431c24de64f\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") "
Sep 19 15:39:02.045678 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.045571    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32cb6c46-413c-4a16-9671-4fa600a4aa7c-tls-certs\") pod \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") "
Sep 19 15:39:02.045678 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.045586    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ba1dc84-2526-41b9-803d-a431c24de64f-tls-certs\") pod \"9ba1dc84-2526-41b9-803d-a431c24de64f\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") "
Sep 19 15:39:02.045678 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.045620    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x98sd\" (UniqueName: \"kubernetes.io/projected/32cb6c46-413c-4a16-9671-4fa600a4aa7c-kube-api-access-x98sd\") pod \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") "
Sep 19 15:39:02.045678 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.045657    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws59d\" (UniqueName: \"kubernetes.io/projected/58b650c0-044b-4468-ae34-7ca78aa2e890-kube-api-access-ws59d\") pod \"58b650c0-044b-4468-ae34-7ca78aa2e890\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") "
Sep 19 15:39:02.045998 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.045797    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-home" (OuterVolumeSpecName: "home") pod "32cb6c46-413c-4a16-9671-4fa600a4aa7c" (UID: "32cb6c46-413c-4a16-9671-4fa600a4aa7c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:39:02.045998 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.045922    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-dshm\") pod \"58b650c0-044b-4468-ae34-7ca78aa2e890\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") "
Sep 19 15:39:02.045998 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.045973    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-model-cache\") pod \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") "
Sep 19 15:39:02.046160 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.046013    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-tmp-dir\") pod \"58b650c0-044b-4468-ae34-7ca78aa2e890\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") "
Sep 19 15:39:02.046160 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.046049    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-tmp-dir\") pod \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\" (UID: \"32cb6c46-413c-4a16-9671-4fa600a4aa7c\") "
Sep 19 15:39:02.046160 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.046103    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-dshm\") pod \"9ba1dc84-2526-41b9-803d-a431c24de64f\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") "
Sep 19 15:39:02.046160 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.046133    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58b650c0-044b-4468-ae34-7ca78aa2e890-tls-certs\") pod \"58b650c0-044b-4468-ae34-7ca78aa2e890\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") "
Sep 19 15:39:02.046430 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.046167    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-tmp-dir\") pod \"9ba1dc84-2526-41b9-803d-a431c24de64f\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") "
Sep 19 15:39:02.046430 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.046393    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-model-cache\") pod \"9ba1dc84-2526-41b9-803d-a431c24de64f\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") "
Sep 19 15:39:02.046430 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.046422    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-home\") pod \"9ba1dc84-2526-41b9-803d-a431c24de64f\" (UID: \"9ba1dc84-2526-41b9-803d-a431c24de64f\") "
Sep 19 15:39:02.046748 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.046479    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-model-cache\") pod \"58b650c0-044b-4468-ae34-7ca78aa2e890\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") "
Sep 19 15:39:02.046748 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.046523    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-home\") pod \"58b650c0-044b-4468-ae34-7ca78aa2e890\" (UID: \"58b650c0-044b-4468-ae34-7ca78aa2e890\") "
Sep 19 15:39:02.047004 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.046984    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-home\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.047282 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.047256    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-home" (OuterVolumeSpecName: "home") pod "58b650c0-044b-4468-ae34-7ca78aa2e890" (UID: "58b650c0-044b-4468-ae34-7ca78aa2e890"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:39:02.047474 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.047451    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-model-cache" (OuterVolumeSpecName: "model-cache") pod "32cb6c46-413c-4a16-9671-4fa600a4aa7c" (UID: "32cb6c46-413c-4a16-9671-4fa600a4aa7c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:39:02.047659 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.047635    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "58b650c0-044b-4468-ae34-7ca78aa2e890" (UID: "58b650c0-044b-4468-ae34-7ca78aa2e890"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:39:02.047820 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.047802    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "32cb6c46-413c-4a16-9671-4fa600a4aa7c" (UID: "32cb6c46-413c-4a16-9671-4fa600a4aa7c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:39:02.048578 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.048547    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32cb6c46-413c-4a16-9671-4fa600a4aa7c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "32cb6c46-413c-4a16-9671-4fa600a4aa7c" (UID: "32cb6c46-413c-4a16-9671-4fa600a4aa7c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:39:02.048578 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.048547    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ba1dc84-2526-41b9-803d-a431c24de64f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9ba1dc84-2526-41b9-803d-a431c24de64f" (UID: "9ba1dc84-2526-41b9-803d-a431c24de64f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:39:02.048754 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.048641    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b650c0-044b-4468-ae34-7ca78aa2e890-kube-api-access-ws59d" (OuterVolumeSpecName: "kube-api-access-ws59d") pod "58b650c0-044b-4468-ae34-7ca78aa2e890" (UID: "58b650c0-044b-4468-ae34-7ca78aa2e890"). InnerVolumeSpecName "kube-api-access-ws59d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:39:02.048754 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.048685    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ba1dc84-2526-41b9-803d-a431c24de64f-kube-api-access-zwkv5" (OuterVolumeSpecName: "kube-api-access-zwkv5") pod "9ba1dc84-2526-41b9-803d-a431c24de64f" (UID: "9ba1dc84-2526-41b9-803d-a431c24de64f"). InnerVolumeSpecName "kube-api-access-zwkv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:39:02.048879 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.048783    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-model-cache" (OuterVolumeSpecName: "model-cache") pod "9ba1dc84-2526-41b9-803d-a431c24de64f" (UID: "9ba1dc84-2526-41b9-803d-a431c24de64f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:39:02.048879 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.048794    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-dshm" (OuterVolumeSpecName: "dshm") pod "32cb6c46-413c-4a16-9671-4fa600a4aa7c" (UID: "32cb6c46-413c-4a16-9671-4fa600a4aa7c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:39:02.048879 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.048857    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-home" (OuterVolumeSpecName: "home") pod "9ba1dc84-2526-41b9-803d-a431c24de64f" (UID: "9ba1dc84-2526-41b9-803d-a431c24de64f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:39:02.049000 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.048960    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-model-cache" (OuterVolumeSpecName: "model-cache") pod "58b650c0-044b-4468-ae34-7ca78aa2e890" (UID: "58b650c0-044b-4468-ae34-7ca78aa2e890"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:39:02.049045 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.049026    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9ba1dc84-2526-41b9-803d-a431c24de64f" (UID: "9ba1dc84-2526-41b9-803d-a431c24de64f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:39:02.049334 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.049306    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32cb6c46-413c-4a16-9671-4fa600a4aa7c-kube-api-access-x98sd" (OuterVolumeSpecName: "kube-api-access-x98sd") pod "32cb6c46-413c-4a16-9671-4fa600a4aa7c" (UID: "32cb6c46-413c-4a16-9671-4fa600a4aa7c"). InnerVolumeSpecName "kube-api-access-x98sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:39:02.049573 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.049553    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-dshm" (OuterVolumeSpecName: "dshm") pod "58b650c0-044b-4468-ae34-7ca78aa2e890" (UID: "58b650c0-044b-4468-ae34-7ca78aa2e890"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:39:02.050165 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.050142    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-dshm" (OuterVolumeSpecName: "dshm") pod "9ba1dc84-2526-41b9-803d-a431c24de64f" (UID: "9ba1dc84-2526-41b9-803d-a431c24de64f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:39:02.050635 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.050619    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b650c0-044b-4468-ae34-7ca78aa2e890-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "58b650c0-044b-4468-ae34-7ca78aa2e890" (UID: "58b650c0-044b-4468-ae34-7ca78aa2e890"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:39:02.148295 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.148217    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-tmp-dir\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.148295 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.148248    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-dshm\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.148295 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.148258    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58b650c0-044b-4468-ae34-7ca78aa2e890-tls-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.148295 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.148266    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-tmp-dir\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.148295 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.148275    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-model-cache\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.148295 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.148282    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ba1dc84-2526-41b9-803d-a431c24de64f-home\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.148295 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.148289    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-model-cache\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.148295 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.148296    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-home\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.148295 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.148303    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-dshm\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.148680 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.148311    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwkv5\" (UniqueName: \"kubernetes.io/projected/9ba1dc84-2526-41b9-803d-a431c24de64f-kube-api-access-zwkv5\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.148680 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.148319    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32cb6c46-413c-4a16-9671-4fa600a4aa7c-tls-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.148680 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.148326    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ba1dc84-2526-41b9-803d-a431c24de64f-tls-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.148680 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.148333    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x98sd\" (UniqueName: \"kubernetes.io/projected/32cb6c46-413c-4a16-9671-4fa600a4aa7c-kube-api-access-x98sd\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.148680 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.148342    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws59d\" (UniqueName: \"kubernetes.io/projected/58b650c0-044b-4468-ae34-7ca78aa2e890-kube-api-access-ws59d\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.148680 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.148350    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-dshm\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.148680 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.148358    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32cb6c46-413c-4a16-9671-4fa600a4aa7c-model-cache\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.148680 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.148365    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58b650c0-044b-4468-ae34-7ca78aa2e890-tmp-dir\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:02.393381 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.393345    2562 generic.go:356] "Generic (PLEG): container finished" podID="32cb6c46-413c-4a16-9671-4fa600a4aa7c" containerID="111bd34e9aee0daa7acbc74d94e47c39efef4978a69299f74c6ec70fd9900b43" exitCode=0
Sep 19 15:39:02.393572 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.393399    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"
Sep 19 15:39:02.393572 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.393435    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg" event={"ID":"32cb6c46-413c-4a16-9671-4fa600a4aa7c","Type":"ContainerDied","Data":"111bd34e9aee0daa7acbc74d94e47c39efef4978a69299f74c6ec70fd9900b43"}
Sep 19 15:39:02.393572 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.393481    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg" event={"ID":"32cb6c46-413c-4a16-9671-4fa600a4aa7c","Type":"ContainerDied","Data":"f727d371621cef39f69d265cbe29a9108714cebc96e5097b5c68cd0f59b3b41c"}
Sep 19 15:39:02.393572 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.393509    2562 scope.go:117] "RemoveContainer" containerID="111bd34e9aee0daa7acbc74d94e47c39efef4978a69299f74c6ec70fd9900b43"
Sep 19 15:39:02.395175 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.395095    2562 generic.go:356] "Generic (PLEG): container finished" podID="58b650c0-044b-4468-ae34-7ca78aa2e890" containerID="5b2a4e2c81a93c69b7e99992d974a78b21cca32e0917bdd57056064d61ceeda3" exitCode=0
Sep 19 15:39:02.395175 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.395126    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7" event={"ID":"58b650c0-044b-4468-ae34-7ca78aa2e890","Type":"ContainerDied","Data":"5b2a4e2c81a93c69b7e99992d974a78b21cca32e0917bdd57056064d61ceeda3"}
Sep 19 15:39:02.395367 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.395159    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"
Sep 19 15:39:02.395367 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.395331    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7" event={"ID":"58b650c0-044b-4468-ae34-7ca78aa2e890","Type":"ContainerDied","Data":"6a0c4ca106bc56afa3e3da93e1f41a87958b63a6496679de092ac85186d24637"}
Sep 19 15:39:02.396941 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.396918    2562 generic.go:356] "Generic (PLEG): container finished" podID="9ba1dc84-2526-41b9-803d-a431c24de64f" containerID="4d97966e9d6cf09e6eacec12546858c3d71c9e6745314ac6cdfffc62dc2b2e99" exitCode=0
Sep 19 15:39:02.397072 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.396959    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"
Sep 19 15:39:02.397072 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.396969    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd" event={"ID":"9ba1dc84-2526-41b9-803d-a431c24de64f","Type":"ContainerDied","Data":"4d97966e9d6cf09e6eacec12546858c3d71c9e6745314ac6cdfffc62dc2b2e99"}
Sep 19 15:39:02.397072 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.396994    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd" event={"ID":"9ba1dc84-2526-41b9-803d-a431c24de64f","Type":"ContainerDied","Data":"e415ee4ab6fc8ae1f2fadb463655a7d829d69b802af97a7462e9fa08322e98c8"}
Sep 19 15:39:02.405145 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.405112    2562 scope.go:117] "RemoveContainer" containerID="111bd34e9aee0daa7acbc74d94e47c39efef4978a69299f74c6ec70fd9900b43"
Sep 19 15:39:02.405524 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:39:02.405500    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"111bd34e9aee0daa7acbc74d94e47c39efef4978a69299f74c6ec70fd9900b43\": container with ID starting with 111bd34e9aee0daa7acbc74d94e47c39efef4978a69299f74c6ec70fd9900b43 not found: ID does not exist" containerID="111bd34e9aee0daa7acbc74d94e47c39efef4978a69299f74c6ec70fd9900b43"
Sep 19 15:39:02.405683 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.405659    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"111bd34e9aee0daa7acbc74d94e47c39efef4978a69299f74c6ec70fd9900b43"} err="failed to get container status \"111bd34e9aee0daa7acbc74d94e47c39efef4978a69299f74c6ec70fd9900b43\": rpc error: code = NotFound desc = could not find container \"111bd34e9aee0daa7acbc74d94e47c39efef4978a69299f74c6ec70fd9900b43\": container with ID starting with 111bd34e9aee0daa7acbc74d94e47c39efef4978a69299f74c6ec70fd9900b43 not found: ID does not exist"
Sep 19 15:39:02.405683 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.405684    2562 scope.go:117] "RemoveContainer" containerID="5b2a4e2c81a93c69b7e99992d974a78b21cca32e0917bdd57056064d61ceeda3"
Sep 19 15:39:02.414076 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.414062    2562 scope.go:117] "RemoveContainer" containerID="5b2a4e2c81a93c69b7e99992d974a78b21cca32e0917bdd57056064d61ceeda3"
Sep 19 15:39:02.414339 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:39:02.414324    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b2a4e2c81a93c69b7e99992d974a78b21cca32e0917bdd57056064d61ceeda3\": container with ID starting with 5b2a4e2c81a93c69b7e99992d974a78b21cca32e0917bdd57056064d61ceeda3 not found: ID does not exist" containerID="5b2a4e2c81a93c69b7e99992d974a78b21cca32e0917bdd57056064d61ceeda3"
Sep 19 15:39:02.414390 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.414347    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b2a4e2c81a93c69b7e99992d974a78b21cca32e0917bdd57056064d61ceeda3"} err="failed to get container status \"5b2a4e2c81a93c69b7e99992d974a78b21cca32e0917bdd57056064d61ceeda3\": rpc error: code = NotFound desc = could not find container \"5b2a4e2c81a93c69b7e99992d974a78b21cca32e0917bdd57056064d61ceeda3\": container with ID starting with 5b2a4e2c81a93c69b7e99992d974a78b21cca32e0917bdd57056064d61ceeda3 not found: ID does not exist"
Sep 19 15:39:02.414390 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.414363    2562 scope.go:117] "RemoveContainer" containerID="4d97966e9d6cf09e6eacec12546858c3d71c9e6745314ac6cdfffc62dc2b2e99"
Sep 19 15:39:02.417561 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.417542    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"]
Sep 19 15:39:02.421835 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.421814    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-15949d/simulator-w0-15949d-kserve-849d8c8487-467zg"]
Sep 19 15:39:02.422627 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.422614    2562 scope.go:117] "RemoveContainer" containerID="4d97966e9d6cf09e6eacec12546858c3d71c9e6745314ac6cdfffc62dc2b2e99"
Sep 19 15:39:02.422882 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:39:02.422867    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d97966e9d6cf09e6eacec12546858c3d71c9e6745314ac6cdfffc62dc2b2e99\": container with ID starting with 4d97966e9d6cf09e6eacec12546858c3d71c9e6745314ac6cdfffc62dc2b2e99 not found: ID does not exist" containerID="4d97966e9d6cf09e6eacec12546858c3d71c9e6745314ac6cdfffc62dc2b2e99"
Sep 19 15:39:02.422948 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.422891    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d97966e9d6cf09e6eacec12546858c3d71c9e6745314ac6cdfffc62dc2b2e99"} err="failed to get container status \"4d97966e9d6cf09e6eacec12546858c3d71c9e6745314ac6cdfffc62dc2b2e99\": rpc error: code = NotFound desc = could not find container \"4d97966e9d6cf09e6eacec12546858c3d71c9e6745314ac6cdfffc62dc2b2e99\": container with ID starting with 4d97966e9d6cf09e6eacec12546858c3d71c9e6745314ac6cdfffc62dc2b2e99 not found: ID does not exist"
Sep 19 15:39:02.429478 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.429459    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"]
Sep 19 15:39:02.434699 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.434680    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-15949d/embedding-w0-15949d-kserve-5548c68f7d-t48vd"]
Sep 19 15:39:02.443581 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.443559    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"]
Sep 19 15:39:02.445622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:02.445600    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-15949d/distinct-2-w0-15949d-kserve-586857bd9d-rzjv7"]
Sep 19 15:39:03.065741 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:03.065701    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:03.336054 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:03.335975    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:03.347058 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:03.347035    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32cb6c46-413c-4a16-9671-4fa600a4aa7c" path="/var/lib/kubelet/pods/32cb6c46-413c-4a16-9671-4fa600a4aa7c/volumes"
Sep 19 15:39:03.347454 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:03.347441    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58b650c0-044b-4468-ae34-7ca78aa2e890" path="/var/lib/kubelet/pods/58b650c0-044b-4468-ae34-7ca78aa2e890/volumes"
Sep 19 15:39:03.347786 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:03.347774    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ba1dc84-2526-41b9-803d-a431c24de64f" path="/var/lib/kubelet/pods/9ba1dc84-2526-41b9-803d-a431c24de64f/volumes"
Sep 19 15:39:03.434050 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:03.434023    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:03.572571 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:03.572538    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"]
Sep 19 15:39:03.572823 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:03.572798    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7" podUID="30c89743-402c-4b86-ac4f-eb6c9b35994a" containerName="istio-proxy" containerID="cri-o://deb795e21a50139d371bd23af431577ae0907063e03440e934a53e017945358c" gracePeriod=30
Sep 19 15:39:03.592927 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:03.592854    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:05.662209 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:05.662166    2562 patch_prober.go:28] interesting pod/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 15:39:05.662558 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:05.662242    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7" podUID="30c89743-402c-4b86-ac4f-eb6c9b35994a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 15:39:07.419827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:07.419785    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:08.733821 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.733787    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:08.800309 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.798540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:08.848348 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.848292    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:39:08.873339 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.873271    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:08.908958 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.908923    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gvxv\" (UniqueName: \"kubernetes.io/projected/30c89743-402c-4b86-ac4f-eb6c9b35994a-kube-api-access-9gvxv\") pod \"30c89743-402c-4b86-ac4f-eb6c9b35994a\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") "
Sep 19 15:39:08.909100 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.908978    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30c89743-402c-4b86-ac4f-eb6c9b35994a-istiod-ca-cert\") pod \"30c89743-402c-4b86-ac4f-eb6c9b35994a\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") "
Sep 19 15:39:08.909100 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.909045    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-workload-socket\") pod \"30c89743-402c-4b86-ac4f-eb6c9b35994a\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") "
Sep 19 15:39:08.909100 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.909096    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-token\") pod \"30c89743-402c-4b86-ac4f-eb6c9b35994a\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") "
Sep 19 15:39:08.909271 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.909148    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-workload-certs\") pod \"30c89743-402c-4b86-ac4f-eb6c9b35994a\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") "
Sep 19 15:39:08.909271 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.909219    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-envoy\") pod \"30c89743-402c-4b86-ac4f-eb6c9b35994a\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") "
Sep 19 15:39:08.909271 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.909252    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-data\") pod \"30c89743-402c-4b86-ac4f-eb6c9b35994a\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") "
Sep 19 15:39:08.909602 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.909316    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-credential-socket\") pod \"30c89743-402c-4b86-ac4f-eb6c9b35994a\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") "
Sep 19 15:39:08.909602 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.909357    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "30c89743-402c-4b86-ac4f-eb6c9b35994a" (UID: "30c89743-402c-4b86-ac4f-eb6c9b35994a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:39:08.909602 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.909379    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30c89743-402c-4b86-ac4f-eb6c9b35994a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "30c89743-402c-4b86-ac4f-eb6c9b35994a" (UID: "30c89743-402c-4b86-ac4f-eb6c9b35994a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:39:08.909602 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.909559    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-data" (OuterVolumeSpecName: "istio-data") pod "30c89743-402c-4b86-ac4f-eb6c9b35994a" (UID: "30c89743-402c-4b86-ac4f-eb6c9b35994a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:39:08.909602 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.909587    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-podinfo\") pod \"30c89743-402c-4b86-ac4f-eb6c9b35994a\" (UID: \"30c89743-402c-4b86-ac4f-eb6c9b35994a\") "
Sep 19 15:39:08.910039 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.910008    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "30c89743-402c-4b86-ac4f-eb6c9b35994a" (UID: "30c89743-402c-4b86-ac4f-eb6c9b35994a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:39:08.910039 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.910022    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30c89743-402c-4b86-ac4f-eb6c9b35994a-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:08.910039 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.910040    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:08.910237 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.910054    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:08.910722 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.910691    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "30c89743-402c-4b86-ac4f-eb6c9b35994a" (UID: "30c89743-402c-4b86-ac4f-eb6c9b35994a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:39:08.911715 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.911692    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30c89743-402c-4b86-ac4f-eb6c9b35994a-kube-api-access-9gvxv" (OuterVolumeSpecName: "kube-api-access-9gvxv") pod "30c89743-402c-4b86-ac4f-eb6c9b35994a" (UID: "30c89743-402c-4b86-ac4f-eb6c9b35994a"). InnerVolumeSpecName "kube-api-access-9gvxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:39:08.911818 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.911758    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-token" (OuterVolumeSpecName: "istio-token") pod "30c89743-402c-4b86-ac4f-eb6c9b35994a" (UID: "30c89743-402c-4b86-ac4f-eb6c9b35994a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:39:08.912153 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.912128    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "30c89743-402c-4b86-ac4f-eb6c9b35994a" (UID: "30c89743-402c-4b86-ac4f-eb6c9b35994a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:39:08.912544 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.912525    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "30c89743-402c-4b86-ac4f-eb6c9b35994a" (UID: "30c89743-402c-4b86-ac4f-eb6c9b35994a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:39:08.919294 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.919273    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7"]
Sep 19 15:39:08.923451 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.923430    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cbcece2-b7dd7"]
Sep 19 15:39:08.929635 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:08.929616    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:09.012923 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.012803    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:09.012923 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.012844    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:09.012923 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.012859    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gvxv\" (UniqueName: \"kubernetes.io/projected/30c89743-402c-4b86-ac4f-eb6c9b35994a-kube-api-access-9gvxv\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:09.012923 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.012873    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:09.012923 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.012886    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:09.012923 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.012897    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30c89743-402c-4b86-ac4f-eb6c9b35994a-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:39:09.344450 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.344419    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ecf8ef4-19db-4c29-81bf-9515e9f982f3" path="/var/lib/kubelet/pods/4ecf8ef4-19db-4c29-81bf-9515e9f982f3/volumes"
Sep 19 15:39:09.360066 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.360045    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:09.439843 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.439814    2562 generic.go:356] "Generic (PLEG): container finished" podID="30c89743-402c-4b86-ac4f-eb6c9b35994a" containerID="deb795e21a50139d371bd23af431577ae0907063e03440e934a53e017945358c" exitCode=0
Sep 19 15:39:09.440028 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.439915    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7" event={"ID":"30c89743-402c-4b86-ac4f-eb6c9b35994a","Type":"ContainerDied","Data":"deb795e21a50139d371bd23af431577ae0907063e03440e934a53e017945358c"}
Sep 19 15:39:09.440028 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.439936    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"
Sep 19 15:39:09.440028 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.439966    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7" event={"ID":"30c89743-402c-4b86-ac4f-eb6c9b35994a","Type":"ContainerDied","Data":"e2a2cf368e7b87f02ab701e98f183e12ea61e2cf8c8aa5f627a260786bfe2442"}
Sep 19 15:39:09.440028 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.439987    2562 scope.go:117] "RemoveContainer" containerID="deb795e21a50139d371bd23af431577ae0907063e03440e934a53e017945358c"
Sep 19 15:39:09.449359 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.449341    2562 scope.go:117] "RemoveContainer" containerID="c1e4a90f51170529d90b5b7455666ddaacf158970c67913a57fd27a9adb3849e"
Sep 19 15:39:09.460494 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.459686    2562 scope.go:117] "RemoveContainer" containerID="deb795e21a50139d371bd23af431577ae0907063e03440e934a53e017945358c"
Sep 19 15:39:09.462541 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:39:09.462510    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deb795e21a50139d371bd23af431577ae0907063e03440e934a53e017945358c\": container with ID starting with deb795e21a50139d371bd23af431577ae0907063e03440e934a53e017945358c not found: ID does not exist" containerID="deb795e21a50139d371bd23af431577ae0907063e03440e934a53e017945358c"
Sep 19 15:39:09.462647 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.462555    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deb795e21a50139d371bd23af431577ae0907063e03440e934a53e017945358c"} err="failed to get container status \"deb795e21a50139d371bd23af431577ae0907063e03440e934a53e017945358c\": rpc error: code = NotFound desc = could not find container \"deb795e21a50139d371bd23af431577ae0907063e03440e934a53e017945358c\": container with ID starting with deb795e21a50139d371bd23af431577ae0907063e03440e934a53e017945358c not found: ID does not exist"
Sep 19 15:39:09.462647 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.462581    2562 scope.go:117] "RemoveContainer" containerID="c1e4a90f51170529d90b5b7455666ddaacf158970c67913a57fd27a9adb3849e"
Sep 19 15:39:09.462775 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.462678    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"]
Sep 19 15:39:09.463392 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:39:09.463362    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1e4a90f51170529d90b5b7455666ddaacf158970c67913a57fd27a9adb3849e\": container with ID starting with c1e4a90f51170529d90b5b7455666ddaacf158970c67913a57fd27a9adb3849e not found: ID does not exist" containerID="c1e4a90f51170529d90b5b7455666ddaacf158970c67913a57fd27a9adb3849e"
Sep 19 15:39:09.463515 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.463401    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1e4a90f51170529d90b5b7455666ddaacf158970c67913a57fd27a9adb3849e"} err="failed to get container status \"c1e4a90f51170529d90b5b7455666ddaacf158970c67913a57fd27a9adb3849e\": rpc error: code = NotFound desc = could not find container \"c1e4a90f51170529d90b5b7455666ddaacf158970c67913a57fd27a9adb3849e\": container with ID starting with c1e4a90f51170529d90b5b7455666ddaacf158970c67913a57fd27a9adb3849e not found: ID does not exist"
Sep 19 15:39:09.464308 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:09.464286    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7"]
Sep 19 15:39:10.013296 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:10.013269    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:10.882644 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:10.882607    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:11.344378 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:11.344347    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30c89743-402c-4b86-ac4f-eb6c9b35994a" path="/var/lib/kubelet/pods/30c89743-402c-4b86-ac4f-eb6c9b35994a/volumes"
Sep 19 15:39:11.478984 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:11.478953    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:11.959552 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:11.959520    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:12.060862 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:12.060831    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:16.139750 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:16.139717    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:39:16.994450 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:16.994416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:22.821970 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:22.821931    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:22.921663 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:22.921629    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:23.944427 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:23.944390    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:29.387468 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:29.387432    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:32.535536 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:32.535494    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:39:48.161113 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:48.161075    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:48.641675 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:48.641649    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:39:53.129028 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:53.128995    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:53.832633 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:53.832600    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:39:59.458029 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:39:59.457996    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:03.242778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:03.242742    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:40:13.739145 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:13.739113    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:13.794095 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:13.794073    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:13.976266 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:13.976233    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"]
Sep 19 15:40:13.976508 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:13.976484    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7" podUID="a70c3f47-788f-459b-9d88-712dd5385976" containerName="istio-proxy" containerID="cri-o://f1093a3c03c9fc4a9be844a520c216e6ab013ec7365ab717d83b958bebfa15a1" gracePeriod=30
Sep 19 15:40:13.999699 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:13.999629    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:15.156116 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:15.156078    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:15.256448 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:15.256396    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:15.375022 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:15.374993    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:15.965126 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:15.965096    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:16.064541 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:16.064508    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:16.167772 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:16.167746    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:17.368971 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:17.368938    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:17.743105 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:17.743029    2562 scope.go:117] "RemoveContainer" containerID="30f7ed26ad1f8b5aea17303dbd5746642d050210e4cf871584264d2c7c37bc12"
Sep 19 15:40:18.540181 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:18.540149    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:40:19.232996 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.232973    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:40:19.272160 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.272080    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-istio-envoy\") pod \"a70c3f47-788f-459b-9d88-712dd5385976\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") "
Sep 19 15:40:19.272160 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.272135    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-workload-certs\") pod \"a70c3f47-788f-459b-9d88-712dd5385976\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") "
Sep 19 15:40:19.272418 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.272166    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-workload-socket\") pod \"a70c3f47-788f-459b-9d88-712dd5385976\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") "
Sep 19 15:40:19.272418 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.272216    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-credential-socket\") pod \"a70c3f47-788f-459b-9d88-712dd5385976\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") "
Sep 19 15:40:19.272418 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.272297    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a70c3f47-788f-459b-9d88-712dd5385976-istio-podinfo\") pod \"a70c3f47-788f-459b-9d88-712dd5385976\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") "
Sep 19 15:40:19.272418 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.272397    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-istio-data\") pod \"a70c3f47-788f-459b-9d88-712dd5385976\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") "
Sep 19 15:40:19.272628 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.272438    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a70c3f47-788f-459b-9d88-712dd5385976-istiod-ca-cert\") pod \"a70c3f47-788f-459b-9d88-712dd5385976\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") "
Sep 19 15:40:19.272628 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.272477    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wjb4\" (UniqueName: \"kubernetes.io/projected/a70c3f47-788f-459b-9d88-712dd5385976-kube-api-access-6wjb4\") pod \"a70c3f47-788f-459b-9d88-712dd5385976\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") "
Sep 19 15:40:19.272628 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.272479    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a70c3f47-788f-459b-9d88-712dd5385976" (UID: "a70c3f47-788f-459b-9d88-712dd5385976"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:40:19.272628 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.272541    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a70c3f47-788f-459b-9d88-712dd5385976-istio-token\") pod \"a70c3f47-788f-459b-9d88-712dd5385976\" (UID: \"a70c3f47-788f-459b-9d88-712dd5385976\") "
Sep 19 15:40:19.272628 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.272614    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a70c3f47-788f-459b-9d88-712dd5385976" (UID: "a70c3f47-788f-459b-9d88-712dd5385976"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:40:19.272890 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.272812    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a70c3f47-788f-459b-9d88-712dd5385976-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a70c3f47-788f-459b-9d88-712dd5385976" (UID: "a70c3f47-788f-459b-9d88-712dd5385976"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:40:19.273053 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.272987    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:40:19.273053 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.273014    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:40:19.273053 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.273029    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a70c3f47-788f-459b-9d88-712dd5385976-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:40:19.273422 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.273134    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a70c3f47-788f-459b-9d88-712dd5385976" (UID: "a70c3f47-788f-459b-9d88-712dd5385976"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:40:19.273721 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.273665    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-istio-data" (OuterVolumeSpecName: "istio-data") pod "a70c3f47-788f-459b-9d88-712dd5385976" (UID: "a70c3f47-788f-459b-9d88-712dd5385976"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:40:19.275044 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.274974    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a70c3f47-788f-459b-9d88-712dd5385976" (UID: "a70c3f47-788f-459b-9d88-712dd5385976"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:40:19.275437 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.275412    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a70c3f47-788f-459b-9d88-712dd5385976-istio-token" (OuterVolumeSpecName: "istio-token") pod "a70c3f47-788f-459b-9d88-712dd5385976" (UID: "a70c3f47-788f-459b-9d88-712dd5385976"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:40:19.275639 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.275615    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a70c3f47-788f-459b-9d88-712dd5385976-kube-api-access-6wjb4" (OuterVolumeSpecName: "kube-api-access-6wjb4") pod "a70c3f47-788f-459b-9d88-712dd5385976" (UID: "a70c3f47-788f-459b-9d88-712dd5385976"). InnerVolumeSpecName "kube-api-access-6wjb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:40:19.275808 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.275791    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a70c3f47-788f-459b-9d88-712dd5385976-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a70c3f47-788f-459b-9d88-712dd5385976" (UID: "a70c3f47-788f-459b-9d88-712dd5385976"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:40:19.373681 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.373657    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:40:19.373681 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.373680    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wjb4\" (UniqueName: \"kubernetes.io/projected/a70c3f47-788f-459b-9d88-712dd5385976-kube-api-access-6wjb4\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:40:19.373860 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.373691    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a70c3f47-788f-459b-9d88-712dd5385976-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:40:19.373860 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.373699    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:40:19.373860 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.373707    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a70c3f47-788f-459b-9d88-712dd5385976-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:40:19.373860 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.373713    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a70c3f47-788f-459b-9d88-712dd5385976-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:40:19.835960 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.835925    2562 generic.go:356] "Generic (PLEG): container finished" podID="a70c3f47-788f-459b-9d88-712dd5385976" containerID="f1093a3c03c9fc4a9be844a520c216e6ab013ec7365ab717d83b958bebfa15a1" exitCode=0
Sep 19 15:40:19.836403 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.836000    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"
Sep 19 15:40:19.836403 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.836033    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7" event={"ID":"a70c3f47-788f-459b-9d88-712dd5385976","Type":"ContainerDied","Data":"f1093a3c03c9fc4a9be844a520c216e6ab013ec7365ab717d83b958bebfa15a1"}
Sep 19 15:40:19.836403 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.836104    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7" event={"ID":"a70c3f47-788f-459b-9d88-712dd5385976","Type":"ContainerDied","Data":"9d1360ea2e3a75da463fcb7cfd4061e5d0dac9a2b92779b59274f92c8f9139a3"}
Sep 19 15:40:19.836403 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.836138    2562 scope.go:117] "RemoveContainer" containerID="f1093a3c03c9fc4a9be844a520c216e6ab013ec7365ab717d83b958bebfa15a1"
Sep 19 15:40:19.847711 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.847690    2562 scope.go:117] "RemoveContainer" containerID="23129f37e6c568600ae93cf68feab71562630958c2238cd3da3d0a4cb0b16f88"
Sep 19 15:40:19.855230 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.855155    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"]
Sep 19 15:40:19.857091 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.857066    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7"]
Sep 19 15:40:19.857331 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.857317    2562 scope.go:117] "RemoveContainer" containerID="f1093a3c03c9fc4a9be844a520c216e6ab013ec7365ab717d83b958bebfa15a1"
Sep 19 15:40:19.857618 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:40:19.857602    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1093a3c03c9fc4a9be844a520c216e6ab013ec7365ab717d83b958bebfa15a1\": container with ID starting with f1093a3c03c9fc4a9be844a520c216e6ab013ec7365ab717d83b958bebfa15a1 not found: ID does not exist" containerID="f1093a3c03c9fc4a9be844a520c216e6ab013ec7365ab717d83b958bebfa15a1"
Sep 19 15:40:19.857667 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.857625    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1093a3c03c9fc4a9be844a520c216e6ab013ec7365ab717d83b958bebfa15a1"} err="failed to get container status \"f1093a3c03c9fc4a9be844a520c216e6ab013ec7365ab717d83b958bebfa15a1\": rpc error: code = NotFound desc = could not find container \"f1093a3c03c9fc4a9be844a520c216e6ab013ec7365ab717d83b958bebfa15a1\": container with ID starting with f1093a3c03c9fc4a9be844a520c216e6ab013ec7365ab717d83b958bebfa15a1 not found: ID does not exist"
Sep 19 15:40:19.857667 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.857642    2562 scope.go:117] "RemoveContainer" containerID="23129f37e6c568600ae93cf68feab71562630958c2238cd3da3d0a4cb0b16f88"
Sep 19 15:40:19.857889 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:40:19.857872    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23129f37e6c568600ae93cf68feab71562630958c2238cd3da3d0a4cb0b16f88\": container with ID starting with 23129f37e6c568600ae93cf68feab71562630958c2238cd3da3d0a4cb0b16f88 not found: ID does not exist" containerID="23129f37e6c568600ae93cf68feab71562630958c2238cd3da3d0a4cb0b16f88"
Sep 19 15:40:19.857928 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:19.857895    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23129f37e6c568600ae93cf68feab71562630958c2238cd3da3d0a4cb0b16f88"} err="failed to get container status \"23129f37e6c568600ae93cf68feab71562630958c2238cd3da3d0a4cb0b16f88\": rpc error: code = NotFound desc = could not find container \"23129f37e6c568600ae93cf68feab71562630958c2238cd3da3d0a4cb0b16f88\": container with ID starting with 23129f37e6c568600ae93cf68feab71562630958c2238cd3da3d0a4cb0b16f88 not found: ID does not exist"
Sep 19 15:40:21.343890 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:21.343857    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a70c3f47-788f-459b-9d88-712dd5385976" path="/var/lib/kubelet/pods/a70c3f47-788f-459b-9d88-712dd5385976/volumes"
Sep 19 15:40:22.944382 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:22.944335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:23.005507 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:23.005470    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:23.610747 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:23.610707    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:29.436513 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:29.436479    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:29.494593 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:29.494563    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:29.586931 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:29.586898    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:29.686116 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:29.686084    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:33.837919 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:33.837883    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:40:40.103593 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:40.103510    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:40.314380 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:40.314342    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:43.215961 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.215928    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9292-70532d"]
Sep 19 15:40:43.216364 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216349    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30c89743-402c-4b86-ac4f-eb6c9b35994a" containerName="istio-proxy"
Sep 19 15:40:43.216412 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216366    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="30c89743-402c-4b86-ac4f-eb6c9b35994a" containerName="istio-proxy"
Sep 19 15:40:43.216412 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216375    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30c89743-402c-4b86-ac4f-eb6c9b35994a" containerName="istio-proxy"
Sep 19 15:40:43.216412 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216381    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="30c89743-402c-4b86-ac4f-eb6c9b35994a" containerName="istio-proxy"
Sep 19 15:40:43.216412 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216387    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32cb6c46-413c-4a16-9671-4fa600a4aa7c" containerName="main"
Sep 19 15:40:43.216412 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216393    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="32cb6c46-413c-4a16-9671-4fa600a4aa7c" containerName="main"
Sep 19 15:40:43.216412 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216401    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70c3f47-788f-459b-9d88-712dd5385976" containerName="istio-proxy"
Sep 19 15:40:43.216412 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216408    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70c3f47-788f-459b-9d88-712dd5385976" containerName="istio-proxy"
Sep 19 15:40:43.216622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216417    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b650c0-044b-4468-ae34-7ca78aa2e890" containerName="main"
Sep 19 15:40:43.216622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216422    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b650c0-044b-4468-ae34-7ca78aa2e890" containerName="main"
Sep 19 15:40:43.216622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216436    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70c3f47-788f-459b-9d88-712dd5385976" containerName="istio-proxy"
Sep 19 15:40:43.216622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216441    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70c3f47-788f-459b-9d88-712dd5385976" containerName="istio-proxy"
Sep 19 15:40:43.216622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216452    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ecf8ef4-19db-4c29-81bf-9515e9f982f3" containerName="revoke-keys"
Sep 19 15:40:43.216622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216457    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ecf8ef4-19db-4c29-81bf-9515e9f982f3" containerName="revoke-keys"
Sep 19 15:40:43.216622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216465    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ba1dc84-2526-41b9-803d-a431c24de64f" containerName="main"
Sep 19 15:40:43.216622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216470    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ba1dc84-2526-41b9-803d-a431c24de64f" containerName="main"
Sep 19 15:40:43.216622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216531    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ba1dc84-2526-41b9-803d-a431c24de64f" containerName="main"
Sep 19 15:40:43.216622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216539    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a70c3f47-788f-459b-9d88-712dd5385976" containerName="istio-proxy"
Sep 19 15:40:43.216622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216546    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="30c89743-402c-4b86-ac4f-eb6c9b35994a" containerName="istio-proxy"
Sep 19 15:40:43.216622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216552    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="32cb6c46-413c-4a16-9671-4fa600a4aa7c" containerName="main"
Sep 19 15:40:43.216622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216559    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ecf8ef4-19db-4c29-81bf-9515e9f982f3" containerName="revoke-keys"
Sep 19 15:40:43.216622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.216564    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b650c0-044b-4468-ae34-7ca78aa2e890" containerName="main"
Sep 19 15:40:43.221170 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.221155    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9292-70532d"
Sep 19 15:40:43.223387 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.223354    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hj4r7\""
Sep 19 15:40:43.224736 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.224716    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9292-70532d"]
Sep 19 15:40:43.305097 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.305069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-556z9\" (UniqueName: \"kubernetes.io/projected/44b37dca-8318-40ed-af5f-951cfa51812e-kube-api-access-556z9\") pod \"test-curl-9292-70532d\" (UID: \"44b37dca-8318-40ed-af5f-951cfa51812e\") " pod="opendatahub/test-curl-9292-70532d"
Sep 19 15:40:43.406090 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.406061    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-556z9\" (UniqueName: \"kubernetes.io/projected/44b37dca-8318-40ed-af5f-951cfa51812e-kube-api-access-556z9\") pod \"test-curl-9292-70532d\" (UID: \"44b37dca-8318-40ed-af5f-951cfa51812e\") " pod="opendatahub/test-curl-9292-70532d"
Sep 19 15:40:43.413836 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.413810    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-556z9\" (UniqueName: \"kubernetes.io/projected/44b37dca-8318-40ed-af5f-951cfa51812e-kube-api-access-556z9\") pod \"test-curl-9292-70532d\" (UID: \"44b37dca-8318-40ed-af5f-951cfa51812e\") " pod="opendatahub/test-curl-9292-70532d"
Sep 19 15:40:43.532637 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.532581    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9292-70532d"
Sep 19 15:40:43.801073 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.801050    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9292-70532d"]
Sep 19 15:40:43.802978 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:40:43.802949    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44b37dca_8318_40ed_af5f_951cfa51812e.slice/crio-bc048236a7cddf9006f0c7f609d7f0ed28b3019379468bfcd195fce5f3a274aa WatchSource:0}: Error finding container bc048236a7cddf9006f0c7f609d7f0ed28b3019379468bfcd195fce5f3a274aa: Status 404 returned error can't find the container with id bc048236a7cddf9006f0c7f609d7f0ed28b3019379468bfcd195fce5f3a274aa
Sep 19 15:40:43.964273 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.964237    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9292-70532d" event={"ID":"44b37dca-8318-40ed-af5f-951cfa51812e","Type":"ContainerStarted","Data":"308c23b5ec8df227ff647df2fb902e0fcfd8f070174a70080dde0b8a2d6cf110"}
Sep 19 15:40:43.964446 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.964279    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9292-70532d" event={"ID":"44b37dca-8318-40ed-af5f-951cfa51812e","Type":"ContainerStarted","Data":"bc048236a7cddf9006f0c7f609d7f0ed28b3019379468bfcd195fce5f3a274aa"}
Sep 19 15:40:43.977215 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:43.977134    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-9292-70532d" podStartSLOduration=0.977119208 podStartE2EDuration="977.119208ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:40:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:40:43.97602047 +0000 UTC m=+1707.139435510" watchObservedRunningTime="2026-09-19 15:40:43.977119208 +0000 UTC m=+1707.140534247"
Sep 19 15:40:44.563941 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:44.563909    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9292-70532d"]
Sep 19 15:40:44.568793 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:44.568768    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9292-70532d"]
Sep 19 15:40:44.969279 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:40:44.969187    2562 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-9292-70532d" container="test-curl-9292-70532d"
Sep 19 15:40:45.865027 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:45.864987    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"]
Sep 19 15:40:45.883583 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:45.883557    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:45.975443 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:45.975405    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-9292-70532d" podUID="44b37dca-8318-40ed-af5f-951cfa51812e" containerName="test-curl-9292-70532d" containerID="cri-o://308c23b5ec8df227ff647df2fb902e0fcfd8f070174a70080dde0b8a2d6cf110" gracePeriod=2
Sep 19 15:40:46.756914 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:46.756884    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:48.029776 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:48.029753    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:48.133644 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:48.133619    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9292-70532d"
Sep 19 15:40:48.147018 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:48.146997    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-556z9\" (UniqueName: \"kubernetes.io/projected/44b37dca-8318-40ed-af5f-951cfa51812e-kube-api-access-556z9\") pod \"44b37dca-8318-40ed-af5f-951cfa51812e\" (UID: \"44b37dca-8318-40ed-af5f-951cfa51812e\") "
Sep 19 15:40:48.149011 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:48.148986    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44b37dca-8318-40ed-af5f-951cfa51812e-kube-api-access-556z9" (OuterVolumeSpecName: "kube-api-access-556z9") pod "44b37dca-8318-40ed-af5f-951cfa51812e" (UID: "44b37dca-8318-40ed-af5f-951cfa51812e"). InnerVolumeSpecName "kube-api-access-556z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:40:48.248624 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:48.248561    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-556z9\" (UniqueName: \"kubernetes.io/projected/44b37dca-8318-40ed-af5f-951cfa51812e-kube-api-access-556z9\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:40:48.938376 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:48.938342    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:40:48.994144 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:48.994109    2562 generic.go:356] "Generic (PLEG): container finished" podID="44b37dca-8318-40ed-af5f-951cfa51812e" containerID="308c23b5ec8df227ff647df2fb902e0fcfd8f070174a70080dde0b8a2d6cf110" exitCode=137
Sep 19 15:40:48.994370 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:48.994162    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9292-70532d"
Sep 19 15:40:48.994370 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:48.994237    2562 scope.go:117] "RemoveContainer" containerID="308c23b5ec8df227ff647df2fb902e0fcfd8f070174a70080dde0b8a2d6cf110"
Sep 19 15:40:49.003466 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:49.003450    2562 scope.go:117] "RemoveContainer" containerID="308c23b5ec8df227ff647df2fb902e0fcfd8f070174a70080dde0b8a2d6cf110"
Sep 19 15:40:49.003736 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:40:49.003717    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"308c23b5ec8df227ff647df2fb902e0fcfd8f070174a70080dde0b8a2d6cf110\": container with ID starting with 308c23b5ec8df227ff647df2fb902e0fcfd8f070174a70080dde0b8a2d6cf110 not found: ID does not exist" containerID="308c23b5ec8df227ff647df2fb902e0fcfd8f070174a70080dde0b8a2d6cf110"
Sep 19 15:40:49.003827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:49.003744    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"308c23b5ec8df227ff647df2fb902e0fcfd8f070174a70080dde0b8a2d6cf110"} err="failed to get container status \"308c23b5ec8df227ff647df2fb902e0fcfd8f070174a70080dde0b8a2d6cf110\": rpc error: code = NotFound desc = could not find container \"308c23b5ec8df227ff647df2fb902e0fcfd8f070174a70080dde0b8a2d6cf110\": container with ID starting with 308c23b5ec8df227ff647df2fb902e0fcfd8f070174a70080dde0b8a2d6cf110 not found: ID does not exist"
Sep 19 15:40:49.004190 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:40:49.004165    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-9292-70532d\" is forbidden: User \"system:node:ip-10-0-132-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-152.ec2.internal' and this object" podUID="44b37dca-8318-40ed-af5f-951cfa51812e" pod="opendatahub/test-curl-9292-70532d"
Sep 19 15:40:49.347329 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:49.347300    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44b37dca-8318-40ed-af5f-951cfa51812e" path="/var/lib/kubelet/pods/44b37dca-8318-40ed-af5f-951cfa51812e/volumes"
Sep 19 15:40:54.134037 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.134002    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"]
Sep 19 15:40:54.134598 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.134456    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44b37dca-8318-40ed-af5f-951cfa51812e" containerName="test-curl-9292-70532d"
Sep 19 15:40:54.134598 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.134473    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="44b37dca-8318-40ed-af5f-951cfa51812e" containerName="test-curl-9292-70532d"
Sep 19 15:40:54.134598 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.134579    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="30c89743-402c-4b86-ac4f-eb6c9b35994a" containerName="istio-proxy"
Sep 19 15:40:54.134598 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.134596    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="44b37dca-8318-40ed-af5f-951cfa51812e" containerName="test-curl-9292-70532d"
Sep 19 15:40:54.134751 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.134612    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a70c3f47-788f-459b-9d88-712dd5385976" containerName="istio-proxy"
Sep 19 15:40:54.139334 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.139312    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.142490 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.142463    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w2-50372a\"/\"sub-test-model-50372a-kserve-self-signed-certs\""
Sep 19 15:40:54.145078 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.145055    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"]
Sep 19 15:40:54.150981 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.150961    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:40:54.202167 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.202143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-dshm\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.202307 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.202175    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-model-cache\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.202307 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.202225    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5vmd\" (UniqueName: \"kubernetes.io/projected/32a5ef07-713f-4198-8b99-929e0eef1c2d-kube-api-access-s5vmd\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.202307 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.202292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-tmp-dir\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.202476 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.202413    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32a5ef07-713f-4198-8b99-929e0eef1c2d-tls-certs\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.202530 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.202493    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-home\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.303517 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.303490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32a5ef07-713f-4198-8b99-929e0eef1c2d-tls-certs\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.303640 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.303544    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-home\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.303640 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.303582    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-dshm\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.303640 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.303606    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-model-cache\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.303640 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.303629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5vmd\" (UniqueName: \"kubernetes.io/projected/32a5ef07-713f-4198-8b99-929e0eef1c2d-kube-api-access-s5vmd\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.303861 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.303667    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-tmp-dir\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.304105 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.304066    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-model-cache\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.304105 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.304095    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-tmp-dir\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.304249 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.304127    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-home\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.306081 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.306059    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-dshm\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.306280 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.306261    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32a5ef07-713f-4198-8b99-929e0eef1c2d-tls-certs\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.312239 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.312222    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5vmd\" (UniqueName: \"kubernetes.io/projected/32a5ef07-713f-4198-8b99-929e0eef1c2d-kube-api-access-s5vmd\") pod \"sub-test-model-50372a-kserve-6fc8fc4bcf-whzct\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") " pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.449454 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.449369    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:40:54.718047 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:54.718023    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"]
Sep 19 15:40:54.720191 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:40:54.720167    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32a5ef07_713f_4198_8b99_929e0eef1c2d.slice/crio-4ce0d13f03f764c642c414b9d1e2c2092656afcbe8b2da2d899a6721410de6e0 WatchSource:0}: Error finding container 4ce0d13f03f764c642c414b9d1e2c2092656afcbe8b2da2d899a6721410de6e0: Status 404 returned error can't find the container with id 4ce0d13f03f764c642c414b9d1e2c2092656afcbe8b2da2d899a6721410de6e0
Sep 19 15:40:55.029067 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:55.028982    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct" event={"ID":"32a5ef07-713f-4198-8b99-929e0eef1c2d","Type":"ContainerStarted","Data":"a393adf465c3fa0f0908e897bc60a1ffb51391701c07fe166a1270ee53688c0f"}
Sep 19 15:40:55.029067 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:55.029021    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct" event={"ID":"32a5ef07-713f-4198-8b99-929e0eef1c2d","Type":"ContainerStarted","Data":"4ce0d13f03f764c642c414b9d1e2c2092656afcbe8b2da2d899a6721410de6e0"}
Sep 19 15:40:55.045558 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:40:55.045512    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct" podStartSLOduration=1.045495419 podStartE2EDuration="1.045495419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:40:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:40:55.042938611 +0000 UTC m=+1718.206353650" watchObservedRunningTime="2026-09-19 15:40:55.045495419 +0000 UTC m=+1718.208910459"
Sep 19 15:41:00.885049 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:00.885010    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj" podUID="1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d" containerName="main" containerID="cri-o://9c8c7890f225b8bbb86406dc2b8b993d16b151d6e085f2b6149ece719193f7ee" gracePeriod=45
Sep 19 15:41:01.062218 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.062167    2562 generic.go:356] "Generic (PLEG): container finished" podID="1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d" containerID="9c8c7890f225b8bbb86406dc2b8b993d16b151d6e085f2b6149ece719193f7ee" exitCode=0
Sep 19 15:41:01.062345 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.062240    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj" event={"ID":"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d","Type":"ContainerDied","Data":"9c8c7890f225b8bbb86406dc2b8b993d16b151d6e085f2b6149ece719193f7ee"}
Sep 19 15:41:01.150696 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.150637    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:41:01.220529 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.220500    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:01.267941 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.267884    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-model-cache\") pod \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") "
Sep 19 15:41:01.268071 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.268003    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-tmp-dir\") pod \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") "
Sep 19 15:41:01.268071 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.268051    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-home\") pod \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") "
Sep 19 15:41:01.268228 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.268132    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-dshm\") pod \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") "
Sep 19 15:41:01.268228 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.268169    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-tls-certs\") pod \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") "
Sep 19 15:41:01.268349 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.268253    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27lf4\" (UniqueName: \"kubernetes.io/projected/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-kube-api-access-27lf4\") pod \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\" (UID: \"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d\") "
Sep 19 15:41:01.270848 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.270818    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-kube-api-access-27lf4" (OuterVolumeSpecName: "kube-api-access-27lf4") pod "1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d" (UID: "1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d"). InnerVolumeSpecName "kube-api-access-27lf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:41:01.271055 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.271025    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d" (UID: "1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:41:01.271171 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.271113    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-model-cache" (OuterVolumeSpecName: "model-cache") pod "1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d" (UID: "1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:41:01.271431 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.271340    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-home" (OuterVolumeSpecName: "home") pod "1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d" (UID: "1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:41:01.273282 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.273260    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-dshm" (OuterVolumeSpecName: "dshm") pod "1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d" (UID: "1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:41:01.273548 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.273533    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d" (UID: "1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:41:01.369816 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.369793    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27lf4\" (UniqueName: \"kubernetes.io/projected/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-kube-api-access-27lf4\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:41:01.369816 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.369817    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-model-cache\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:41:01.369967 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.369851    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-tmp-dir\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:41:01.369967 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.369864    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-home\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:41:01.369967 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.369875    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-dshm\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:41:01.369967 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:01.369886    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d-tls-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:41:02.068783 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:02.068757    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"
Sep 19 15:41:02.069174 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:02.068750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj" event={"ID":"1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d","Type":"ContainerDied","Data":"3d19481236fe19cf67a40e420727ebbad972a1d8b53534f68ce35f6db18c0de5"}
Sep 19 15:41:02.069174 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:02.068878    2562 scope.go:117] "RemoveContainer" containerID="9c8c7890f225b8bbb86406dc2b8b993d16b151d6e085f2b6149ece719193f7ee"
Sep 19 15:41:02.085473 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:02.085452    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"]
Sep 19 15:41:02.090836 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:02.090811    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/auth-test-model-50372a-kserve-76875658c5-9qzfj"]
Sep 19 15:41:03.344593 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:03.344561    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d" path="/var/lib/kubelet/pods/1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d/volumes"
Sep 19 15:41:04.449641 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:04.449607    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:41:04.450026 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:04.449652    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:41:04.462095 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:04.462073    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:41:05.096139 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:05.096105    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:41:06.838070 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:06.838033    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:06.938078 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:06.938044    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:07.199392 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.199302    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:07.344712 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.344683    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:41:07.473915 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.473833    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"]
Sep 19 15:41:07.474254 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.474239    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d" containerName="main"
Sep 19 15:41:07.474254 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.474254    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d" containerName="main"
Sep 19 15:41:07.474389 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.474325    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cf2edb4-2c9e-41d1-b319-7389d8bfdf1d" containerName="main"
Sep 19 15:41:07.478788 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.478768    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.481064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.481041    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-88b9ff-openshift-default-dockercfg-jst8b\""
Sep 19 15:41:07.491690 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.491664    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"]
Sep 19 15:41:07.496039 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.496015    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:07.627037 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.627001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-istio-envoy\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.627237 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.627043    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c673305b-431c-4607-8802-4fbbc3370c46-istiod-ca-cert\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.627237 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.627110    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-credential-socket\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.627237 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.627168    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-istio-data\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.627352 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.627244    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c673305b-431c-4607-8802-4fbbc3370c46-istio-token\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.627352 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.627274    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-workload-certs\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.627352 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.627292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2wnx\" (UniqueName: \"kubernetes.io/projected/c673305b-431c-4607-8802-4fbbc3370c46-kube-api-access-g2wnx\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.627352 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.627318    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c673305b-431c-4607-8802-4fbbc3370c46-istio-podinfo\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.627476 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.627366    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-workload-socket\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.694456 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.694422    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:07.728225 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.728143    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c673305b-431c-4607-8802-4fbbc3370c46-istio-token\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.728225 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.728177    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-workload-certs\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.728225 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.728223    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2wnx\" (UniqueName: \"kubernetes.io/projected/c673305b-431c-4607-8802-4fbbc3370c46-kube-api-access-g2wnx\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.728486 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.728253    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c673305b-431c-4607-8802-4fbbc3370c46-istio-podinfo\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.728486 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.728278    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-workload-socket\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.728486 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.728321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-istio-envoy\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.728486 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.728351    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c673305b-431c-4607-8802-4fbbc3370c46-istiod-ca-cert\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.728486 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.728391    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-credential-socket\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.728486 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.728422    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-istio-data\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.728806 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.728602    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-workload-certs\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.728806 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.728780    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-workload-socket\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.728806 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.728791    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-istio-data\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.728931 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.728824    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-credential-socket\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.729139 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.729118    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c673305b-431c-4607-8802-4fbbc3370c46-istiod-ca-cert\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.730799 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.730779    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-istio-envoy\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.730937 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.730918    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c673305b-431c-4607-8802-4fbbc3370c46-istio-podinfo\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.735380 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.735353    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2wnx\" (UniqueName: \"kubernetes.io/projected/c673305b-431c-4607-8802-4fbbc3370c46-kube-api-access-g2wnx\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.735469 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.735428    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c673305b-431c-4607-8802-4fbbc3370c46-istio-token\") pod \"e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") " pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:07.789683 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:07.789642    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:08.071567 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:41:08.071539    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc673305b_431c_4607_8802_4fbbc3370c46.slice/crio-4a7789602268ceb690b1033c44aa9ea3299c166cb382c50af9665da1956f3042 WatchSource:0}: Error finding container 4a7789602268ceb690b1033c44aa9ea3299c166cb382c50af9665da1956f3042: Status 404 returned error can't find the container with id 4a7789602268ceb690b1033c44aa9ea3299c166cb382c50af9665da1956f3042
Sep 19 15:41:08.072151 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:08.072128    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"]
Sep 19 15:41:08.074365 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:08.074331    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:41:08.074443 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:08.074409    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:41:08.074485 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:08.074452    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:41:08.102123 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:08.102094    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh" event={"ID":"c673305b-431c-4607-8802-4fbbc3370c46","Type":"ContainerStarted","Data":"4a7789602268ceb690b1033c44aa9ea3299c166cb382c50af9665da1956f3042"}
Sep 19 15:41:08.975899 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:08.975864    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:09.077391 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:09.077360    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:09.109360 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:09.109324    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh" event={"ID":"c673305b-431c-4607-8802-4fbbc3370c46","Type":"ContainerStarted","Data":"5d98c9c3bcde195a065ca8b60906e105f4afa402eabf020ff6743c9dfa523b86"}
Sep 19 15:41:09.126581 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:09.126520    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh" podStartSLOduration=2.126502875 podStartE2EDuration="2.126502875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:41:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:41:09.126018806 +0000 UTC m=+1732.289433849" watchObservedRunningTime="2026-09-19 15:41:09.126502875 +0000 UTC m=+1732.289917916"
Sep 19 15:41:09.790152 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:09.790120    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:09.795546 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:09.795518    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:10.115152 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:10.115073    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:10.115983 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:10.115964    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:10.644758 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:10.644728    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:11.034640 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:11.034607    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:11.128649 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:11.128619    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:11.329496 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:11.329422    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:12.072346 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:12.072316    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:12.748748 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:12.748714    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:13.540412 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:13.540386    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:13.640605 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:13.640572    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:13.740766 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:13.740735    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:14.065692 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:14.065650    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:14.122885 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:14.122854    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:15.938393 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:15.938352    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:17.768064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:17.768032    2562 scope.go:117] "RemoveContainer" containerID="f7f5825b80a11ddb12c7967a2e6da147894f5559329f42c758843728f00733fc"
Sep 19 15:41:20.738126 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:20.738090    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:41:25.731148 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.731115    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"]
Sep 19 15:41:25.734711 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.734693    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.737549 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.737515    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w2-f9c5c2\"/\"openshift-service-ca.crt\""
Sep 19 15:41:25.737692 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.737574    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w2-f9c5c2\"/\"kube-root-ca.crt\""
Sep 19 15:41:25.737692 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.737515    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w2-f9c5c2\"/\"sub-test-model-f9c5c2-kserve-self-signed-certs\""
Sep 19 15:41:25.737692 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.737632    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w2-f9c5c2\"/\"default-dockercfg-zwxth\""
Sep 19 15:41:25.743354 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.743333    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"]
Sep 19 15:41:25.762737 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.762703    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:25.817351 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.817319    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-dshm\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.817533 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.817378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-model-cache\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.817533 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.817471    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-home\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.817665 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.817580    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e23461e-da8e-400a-9672-ba1bd77c9580-tls-certs\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.817665 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.817600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klplg\" (UniqueName: \"kubernetes.io/projected/2e23461e-da8e-400a-9672-ba1bd77c9580-kube-api-access-klplg\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.817665 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.817619    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-tmp-dir\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.919302 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.919271    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-home\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.919499 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.919372    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e23461e-da8e-400a-9672-ba1bd77c9580-tls-certs\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.919499 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.919394    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klplg\" (UniqueName: \"kubernetes.io/projected/2e23461e-da8e-400a-9672-ba1bd77c9580-kube-api-access-klplg\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.919499 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.919420    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-tmp-dir\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.919499 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.919448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-dshm\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.919499 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.919491    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-model-cache\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.919778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.919713    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-home\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.919778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.919765    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-tmp-dir\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.920036 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.920000    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-model-cache\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.922376 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.922356    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e23461e-da8e-400a-9672-ba1bd77c9580-tls-certs\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.922569 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.922551    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-dshm\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:25.927450 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:25.927428    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klplg\" (UniqueName: \"kubernetes.io/projected/2e23461e-da8e-400a-9672-ba1bd77c9580-kube-api-access-klplg\") pod \"sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") " pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:26.044802 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:26.044770    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:26.351327 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:26.351305    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"]
Sep 19 15:41:26.353211 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:41:26.353161    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e23461e_da8e_400a_9672_ba1bd77c9580.slice/crio-d4a84fc1b69afbcee085414b2c4266ef78c74d2588a3579586114c7bca613bcd WatchSource:0}: Error finding container d4a84fc1b69afbcee085414b2c4266ef78c74d2588a3579586114c7bca613bcd: Status 404 returned error can't find the container with id d4a84fc1b69afbcee085414b2c4266ef78c74d2588a3579586114c7bca613bcd
Sep 19 15:41:27.224733 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:27.224699    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d" event={"ID":"2e23461e-da8e-400a-9672-ba1bd77c9580","Type":"ContainerStarted","Data":"82e8511cc9ad95e04bb092cb7aaa617b5233638e1c733b45cafeeface4720ed3"}
Sep 19 15:41:27.225232 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:27.224742    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d" event={"ID":"2e23461e-da8e-400a-9672-ba1bd77c9580","Type":"ContainerStarted","Data":"d4a84fc1b69afbcee085414b2c4266ef78c74d2588a3579586114c7bca613bcd"}
Sep 19 15:41:27.239869 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:27.239456    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d" podStartSLOduration=2.239434736 podStartE2EDuration="2.239434736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:41:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:41:27.239009589 +0000 UTC m=+1750.402424640" watchObservedRunningTime="2026-09-19 15:41:27.239434736 +0000 UTC m=+1750.402849780"
Sep 19 15:41:31.255241 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:31.255183    2562 generic.go:356] "Generic (PLEG): container finished" podID="c673305b-431c-4607-8802-4fbbc3370c46" containerID="5d98c9c3bcde195a065ca8b60906e105f4afa402eabf020ff6743c9dfa523b86" exitCode=0
Sep 19 15:41:31.255749 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:31.255262    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh" event={"ID":"c673305b-431c-4607-8802-4fbbc3370c46","Type":"ContainerDied","Data":"5d98c9c3bcde195a065ca8b60906e105f4afa402eabf020ff6743c9dfa523b86"}
Sep 19 15:41:31.255824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:31.255762    2562 scope.go:117] "RemoveContainer" containerID="5d98c9c3bcde195a065ca8b60906e105f4afa402eabf020ff6743c9dfa523b86"
Sep 19 15:41:31.256846 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:31.256820    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:41:31.256906 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:31.256880    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:41:31.256938 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:31.256909    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:41:32.263415 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:32.263380    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh" event={"ID":"c673305b-431c-4607-8802-4fbbc3370c46","Type":"ContainerStarted","Data":"c3cc5a8567145f1f2c396eb21d12b456e602e8d4ea92dbd9c6cfeead81b61a7d"}
Sep 19 15:41:32.790275 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:32.790245    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:32.790540 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:32.790461    2562 patch_prober.go:28] interesting pod/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 19 15:41:32.790683 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:32.790663    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh" podUID="c673305b-431c-4607-8802-4fbbc3370c46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 19 15:41:33.790504 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:33.790459    2562 patch_prober.go:28] interesting pod/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 19 15:41:33.790998 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:33.790528    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh" podUID="c673305b-431c-4607-8802-4fbbc3370c46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 19 15:41:34.792140 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:34.792105    2562 patch_prober.go:28] interesting pod/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 19 15:41:34.792772 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:34.792742    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh" podUID="c673305b-431c-4607-8802-4fbbc3370c46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 19 15:41:34.940118 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:34.940082    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:35.790516 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:35.790476    2562 patch_prober.go:28] interesting pod/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 19 15:41:35.790796 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:35.790764    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh" podUID="c673305b-431c-4607-8802-4fbbc3370c46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 19 15:41:35.867247 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:35.867214    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:36.045885 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:36.045802    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:36.045885 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:36.045849    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:36.058226 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:36.058186    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:36.322774 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:36.322689    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:41:36.790563 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:36.790521    2562 patch_prober.go:28] interesting pod/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 19 15:41:36.790773 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:36.790589    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh" podUID="c673305b-431c-4607-8802-4fbbc3370c46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 19 15:41:37.039843 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:37.039808    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:37.631619 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:37.631583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:37.794076 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:37.794046    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:37.794347 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:37.794332    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:37.794966 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:37.794953    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:41:38.309243 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:38.309183    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:38.980352 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:38.980320    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:39.659444 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:39.659408    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:40.303159 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:40.303126    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:41.086468 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.086436    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:41.519558 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.519476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:41.788073 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.788042    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"]
Sep 19 15:41:41.792781 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.792760    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.795132 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.795110    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-26cbe6-openshift-default-dockercfg-zmkb9\""
Sep 19 15:41:41.801714 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.801690    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"]
Sep 19 15:41:41.815576 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.815554    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:41.879159 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.879136    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b45e88a-5449-4400-a701-4b4af33c233b-istio-token\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.879267 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.879168    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-workload-socket\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.879267 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.879229    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-workload-certs\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.879345 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.879291    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-istio-envoy\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.879345 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.879316    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr9q8\" (UniqueName: \"kubernetes.io/projected/1b45e88a-5449-4400-a701-4b4af33c233b-kube-api-access-pr9q8\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.879415 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.879372    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b45e88a-5449-4400-a701-4b4af33c233b-istiod-ca-cert\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.879448 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.879427    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-credential-socket\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.879483 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.879469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-istio-data\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.879558 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.879546    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b45e88a-5449-4400-a701-4b4af33c233b-istio-podinfo\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.980486 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.980450    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b45e88a-5449-4400-a701-4b4af33c233b-istio-token\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.980486 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.980488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-workload-socket\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.980727 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.980517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-workload-certs\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.980727 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.980535    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-istio-envoy\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.980727 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.980676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr9q8\" (UniqueName: \"kubernetes.io/projected/1b45e88a-5449-4400-a701-4b4af33c233b-kube-api-access-pr9q8\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.980894 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.980775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b45e88a-5449-4400-a701-4b4af33c233b-istiod-ca-cert\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.980894 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.980819    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-credential-socket\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.980894 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.980873    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-istio-data\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.981042 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.980947    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-workload-socket\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.981042 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.980966    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-workload-certs\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.981042 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.980985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b45e88a-5449-4400-a701-4b4af33c233b-istio-podinfo\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.981231 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.981182    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-credential-socket\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.981305 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.981248    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-istio-data\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.981514 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.981497    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b45e88a-5449-4400-a701-4b4af33c233b-istiod-ca-cert\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.982989 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.982969    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-istio-envoy\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.983561 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.983541    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b45e88a-5449-4400-a701-4b4af33c233b-istio-podinfo\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.987735 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.987715    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr9q8\" (UniqueName: \"kubernetes.io/projected/1b45e88a-5449-4400-a701-4b4af33c233b-kube-api-access-pr9q8\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:41.987827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:41.987736    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b45e88a-5449-4400-a701-4b4af33c233b-istio-token\") pod \"e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") " pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:42.106156 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:42.106072    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:42.197902 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:42.197864    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:42.382508 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:42.382484    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"]
Sep 19 15:41:42.383800 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:41:42.383775    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b45e88a_5449_4400_a701_4b4af33c233b.slice/crio-4d56f46876ac9d8405f9e77b5b190f0e123c6014f1390b75d387eaba147f13d2 WatchSource:0}: Error finding container 4d56f46876ac9d8405f9e77b5b190f0e123c6014f1390b75d387eaba147f13d2: Status 404 returned error can't find the container with id 4d56f46876ac9d8405f9e77b5b190f0e123c6014f1390b75d387eaba147f13d2
Sep 19 15:41:42.386306 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:42.386264    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:41:42.386388 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:42.386350    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:41:42.386428 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:42.386395    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:41:42.537291 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:42.537256    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:41:43.327999 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:43.327965    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r" event={"ID":"1b45e88a-5449-4400-a701-4b4af33c233b","Type":"ContainerStarted","Data":"19c5362f7ff85cf6f3227786402d263fd2442db8f00e912a35e3057c6012971c"}
Sep 19 15:41:43.328384 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:43.328019    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r" event={"ID":"1b45e88a-5449-4400-a701-4b4af33c233b","Type":"ContainerStarted","Data":"4d56f46876ac9d8405f9e77b5b190f0e123c6014f1390b75d387eaba147f13d2"}
Sep 19 15:41:43.346676 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:43.346608    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r" podStartSLOduration=2.346593486 podStartE2EDuration="2.346593486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:41:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:41:43.345655074 +0000 UTC m=+1766.509070115" watchObservedRunningTime="2026-09-19 15:41:43.346593486 +0000 UTC m=+1766.510008525"
Sep 19 15:41:44.107256 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:44.107227    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:44.112128 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:44.112104    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:44.333049 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:44.333024    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:44.333856 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:44.333838    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:41:44.555062 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:44.555033    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:45.165851 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:45.165817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:45.373895 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:45.373862    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:45.528062 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:45.527986    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:46.051942 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:46.051912    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:46.777344 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:46.777314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:47.479863 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:47.479827    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:48.231542 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:48.231509    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:48.861147 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:48.861111    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:48.959964 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:48.959934    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:49.213947 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:49.213868    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:49.388602 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:49.388571    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:49.485348 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:49.485270    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:51.369224 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:51.369169    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:41:55.247643 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:41:55.247608    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:42:06.467186 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:06.467152    2562 generic.go:356] "Generic (PLEG): container finished" podID="1b45e88a-5449-4400-a701-4b4af33c233b" containerID="19c5362f7ff85cf6f3227786402d263fd2442db8f00e912a35e3057c6012971c" exitCode=0
Sep 19 15:42:06.467680 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:06.467226    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r" event={"ID":"1b45e88a-5449-4400-a701-4b4af33c233b","Type":"ContainerDied","Data":"19c5362f7ff85cf6f3227786402d263fd2442db8f00e912a35e3057c6012971c"}
Sep 19 15:42:06.467680 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:06.467564    2562 scope.go:117] "RemoveContainer" containerID="19c5362f7ff85cf6f3227786402d263fd2442db8f00e912a35e3057c6012971c"
Sep 19 15:42:06.468666 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:06.468630    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:42:06.468912 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:06.468717    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:42:06.468912 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:06.468764    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:42:07.474525 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:07.474488    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r" event={"ID":"1b45e88a-5449-4400-a701-4b4af33c233b","Type":"ContainerStarted","Data":"778f6ee72a3252870e32ae4f86434d26408ee3fe25a87a16feb7e0ce82919ad6"}
Sep 19 15:42:08.107276 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:08.107241    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:42:08.107704 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:08.107586    2562 patch_prober.go:28] interesting pod/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 19 15:42:08.107900 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:08.107878    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r" podUID="1b45e88a-5449-4400-a701-4b4af33c233b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 19 15:42:09.106567 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:09.106524    2562 patch_prober.go:28] interesting pod/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 19 15:42:09.107232 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:09.107179    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r" podUID="1b45e88a-5449-4400-a701-4b4af33c233b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 19 15:42:10.107159 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:10.107121    2562 patch_prober.go:28] interesting pod/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 19 15:42:10.108127 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:10.107719    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r" podUID="1b45e88a-5449-4400-a701-4b4af33c233b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 19 15:42:10.336381 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:10.336341    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:11.106682 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:11.106638    2562 patch_prober.go:28] interesting pod/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 19 15:42:11.106883 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:11.106721    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r" podUID="1b45e88a-5449-4400-a701-4b4af33c233b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 19 15:42:11.558245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:11.558215    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:12.106889 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:12.106845    2562 patch_prober.go:28] interesting pod/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 19 15:42:12.107092 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:12.106912    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r" podUID="1b45e88a-5449-4400-a701-4b4af33c233b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 19 15:42:12.266671 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:12.266644    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:12.867536 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:12.867503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:13.244903 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:13.244821    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:42:13.245327 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:13.245309    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:42:13.245987 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:13.245973    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:42:13.313087 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:13.313058    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9292-d38529"]
Sep 19 15:42:13.315621 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:13.315600    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9292-d38529"
Sep 19 15:42:13.317637 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:13.317617    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hj4r7\""
Sep 19 15:42:13.321408 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:13.321388    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9292-d38529"]
Sep 19 15:42:13.412107 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:13.412073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2tbz\" (UniqueName: \"kubernetes.io/projected/eff1de51-f778-4b69-a334-730a35ee4e4f-kube-api-access-t2tbz\") pod \"test-curl-9292-d38529\" (UID: \"eff1de51-f778-4b69-a334-730a35ee4e4f\") " pod="opendatahub/test-curl-9292-d38529"
Sep 19 15:42:13.513732 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:13.513654    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2tbz\" (UniqueName: \"kubernetes.io/projected/eff1de51-f778-4b69-a334-730a35ee4e4f-kube-api-access-t2tbz\") pod \"test-curl-9292-d38529\" (UID: \"eff1de51-f778-4b69-a334-730a35ee4e4f\") " pod="opendatahub/test-curl-9292-d38529"
Sep 19 15:42:13.520812 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:13.520783    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2tbz\" (UniqueName: \"kubernetes.io/projected/eff1de51-f778-4b69-a334-730a35ee4e4f-kube-api-access-t2tbz\") pod \"test-curl-9292-d38529\" (UID: \"eff1de51-f778-4b69-a334-730a35ee4e4f\") " pod="opendatahub/test-curl-9292-d38529"
Sep 19 15:42:13.626808 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:13.626782    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9292-d38529"
Sep 19 15:42:13.678381 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:13.678308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:13.906511 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:13.906490    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9292-d38529"]
Sep 19 15:42:13.908124 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:42:13.908088    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeff1de51_f778_4b69_a334_730a35ee4e4f.slice/crio-04677fb0ebeb36af8b022a077b889dc1e0691080214afc800457c13c9fde63b1 WatchSource:0}: Error finding container 04677fb0ebeb36af8b022a077b889dc1e0691080214afc800457c13c9fde63b1: Status 404 returned error can't find the container with id 04677fb0ebeb36af8b022a077b889dc1e0691080214afc800457c13c9fde63b1
Sep 19 15:42:14.357099 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:14.357040    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:14.528245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:14.528190    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9292-d38529" event={"ID":"eff1de51-f778-4b69-a334-730a35ee4e4f","Type":"ContainerStarted","Data":"b0df508f96972aed001be7d8dfae5a6c9a318315c2fd75cb7dc648b4ec9e7cce"}
Sep 19 15:42:14.528423 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:14.528256    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9292-d38529" event={"ID":"eff1de51-f778-4b69-a334-730a35ee4e4f","Type":"ContainerStarted","Data":"04677fb0ebeb36af8b022a077b889dc1e0691080214afc800457c13c9fde63b1"}
Sep 19 15:42:14.542236 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:14.542181    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-9292-d38529" podStartSLOduration=1.5421658489999999 podStartE2EDuration="1.542165849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:42:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:42:14.540386522 +0000 UTC m=+1797.703801562" watchObservedRunningTime="2026-09-19 15:42:14.542165849 +0000 UTC m=+1797.705580889"
Sep 19 15:42:15.039469 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:15.039433    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:15.124406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:15.124369    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9292-d38529"]
Sep 19 15:42:15.129526 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:15.129497    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9292-d38529"]
Sep 19 15:42:15.254062 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:15.254032    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9292-3de138"]
Sep 19 15:42:15.254509 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:15.254494    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eff1de51-f778-4b69-a334-730a35ee4e4f" containerName="test-curl-9292-d38529"
Sep 19 15:42:15.254568 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:15.254511    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eff1de51-f778-4b69-a334-730a35ee4e4f" containerName="test-curl-9292-d38529"
Sep 19 15:42:15.254605 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:15.254574    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="eff1de51-f778-4b69-a334-730a35ee4e4f" containerName="test-curl-9292-d38529"
Sep 19 15:42:15.256560 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:15.256544    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9292-3de138"
Sep 19 15:42:15.262781 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:15.262755    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9292-3de138"]
Sep 19 15:42:15.276244 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:15.276174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:15.334704 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:15.334639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v88m\" (UniqueName: \"kubernetes.io/projected/8474fdc3-c6ea-49a2-82ec-a50508fbe434-kube-api-access-9v88m\") pod \"test-curl-9292-3de138\" (UID: \"8474fdc3-c6ea-49a2-82ec-a50508fbe434\") " pod="opendatahub/test-curl-9292-3de138"
Sep 19 15:42:15.435962 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:15.435924    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v88m\" (UniqueName: \"kubernetes.io/projected/8474fdc3-c6ea-49a2-82ec-a50508fbe434-kube-api-access-9v88m\") pod \"test-curl-9292-3de138\" (UID: \"8474fdc3-c6ea-49a2-82ec-a50508fbe434\") " pod="opendatahub/test-curl-9292-3de138"
Sep 19 15:42:15.443076 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:15.443058    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v88m\" (UniqueName: \"kubernetes.io/projected/8474fdc3-c6ea-49a2-82ec-a50508fbe434-kube-api-access-9v88m\") pod \"test-curl-9292-3de138\" (UID: \"8474fdc3-c6ea-49a2-82ec-a50508fbe434\") " pod="opendatahub/test-curl-9292-3de138"
Sep 19 15:42:15.534570 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:42:15.534541    2562 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-9292-d38529" container="test-curl-9292-d38529"
Sep 19 15:42:15.557208 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:15.557137    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:15.567953 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:15.567930    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9292-3de138"
Sep 19 15:42:15.835821 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:15.835798    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9292-3de138"]
Sep 19 15:42:15.837848 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:42:15.837823    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8474fdc3_c6ea_49a2_82ec_a50508fbe434.slice/crio-f88b1b1345cb63418a74689f8afda6b391be40022d6bc3ada13c16b182ae9b04 WatchSource:0}: Error finding container f88b1b1345cb63418a74689f8afda6b391be40022d6bc3ada13c16b182ae9b04: Status 404 returned error can't find the container with id f88b1b1345cb63418a74689f8afda6b391be40022d6bc3ada13c16b182ae9b04
Sep 19 15:42:16.541854 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:16.541819    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9292-3de138" event={"ID":"8474fdc3-c6ea-49a2-82ec-a50508fbe434","Type":"ContainerStarted","Data":"f8678f4a5af009766b221023d39ceef3856c2cc6b936b71e87aa05b5474b1443"}
Sep 19 15:42:16.541854 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:16.541862    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9292-3de138" event={"ID":"8474fdc3-c6ea-49a2-82ec-a50508fbe434","Type":"ContainerStarted","Data":"f88b1b1345cb63418a74689f8afda6b391be40022d6bc3ada13c16b182ae9b04"}
Sep 19 15:42:16.542387 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:16.541967    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-9292-d38529" podUID="eff1de51-f778-4b69-a334-730a35ee4e4f" containerName="test-curl-9292-d38529" containerID="cri-o://b0df508f96972aed001be7d8dfae5a6c9a318315c2fd75cb7dc648b4ec9e7cce" gracePeriod=2
Sep 19 15:42:16.556315 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:16.556268    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-9292-3de138" podStartSLOduration=1.556252541 podStartE2EDuration="1.556252541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:42:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:42:16.554451127 +0000 UTC m=+1799.717866167" watchObservedRunningTime="2026-09-19 15:42:16.556252541 +0000 UTC m=+1799.719667581"
Sep 19 15:42:17.115296 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:17.115263    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9292-3de138"]
Sep 19 15:42:17.120940 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:17.120915    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9292-3de138"]
Sep 19 15:42:17.547065 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:42:17.547035    2562 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-9292-3de138" container="test-curl-9292-3de138"
Sep 19 15:42:17.812531 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:17.812448    2562 scope.go:117] "RemoveContainer" containerID="320dc7a1a706125a7e7c0af5ca28f56e8e4f1a09e0d0c6d6f28abfb16c6725e6"
Sep 19 15:42:17.943580 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:17.943547    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:42:18.007476 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.007448    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg"]
Sep 19 15:42:18.007866 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.007854    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8474fdc3-c6ea-49a2-82ec-a50508fbe434" containerName="test-curl-9292-3de138"
Sep 19 15:42:18.007907 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.007868    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8474fdc3-c6ea-49a2-82ec-a50508fbe434" containerName="test-curl-9292-3de138"
Sep 19 15:42:18.007963 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.007954    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8474fdc3-c6ea-49a2-82ec-a50508fbe434" containerName="test-curl-9292-3de138"
Sep 19 15:42:18.010693 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.010677    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg"
Sep 19 15:42:18.012733 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.012710    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 15:42:18.012826 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.012775    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7znsl\""
Sep 19 15:42:18.017269 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.017248    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg"]
Sep 19 15:42:18.162616 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.162546    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38db3e96-bb11-4d9d-b7b4-39b26916df90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg\" (UID: \"38db3e96-bb11-4d9d-b7b4-39b26916df90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg"
Sep 19 15:42:18.263695 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.263670    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38db3e96-bb11-4d9d-b7b4-39b26916df90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg\" (UID: \"38db3e96-bb11-4d9d-b7b4-39b26916df90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg"
Sep 19 15:42:18.264306 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.264288    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38db3e96-bb11-4d9d-b7b4-39b26916df90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg\" (UID: \"38db3e96-bb11-4d9d-b7b4-39b26916df90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg"
Sep 19 15:42:18.323045 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.323021    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg"
Sep 19 15:42:18.338733 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.338707    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:18.554021 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.553963    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-9292-3de138" podUID="8474fdc3-c6ea-49a2-82ec-a50508fbe434" containerName="test-curl-9292-3de138" containerID="cri-o://f8678f4a5af009766b221023d39ceef3856c2cc6b936b71e87aa05b5474b1443" gracePeriod=2
Sep 19 15:42:18.592574 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.592546    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg"]
Sep 19 15:42:18.601393 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:42:18.601360    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38db3e96_bb11_4d9d_b7b4_39b26916df90.slice/crio-589e9ce03ff1f06eba2ee60dd6b7d200b13f0786b7c95e8d0877c0aad94a76f4 WatchSource:0}: Error finding container 589e9ce03ff1f06eba2ee60dd6b7d200b13f0786b7c95e8d0877c0aad94a76f4: Status 404 returned error can't find the container with id 589e9ce03ff1f06eba2ee60dd6b7d200b13f0786b7c95e8d0877c0aad94a76f4
Sep 19 15:42:18.703035 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.703013    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9292-d38529"
Sep 19 15:42:18.768842 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.768816    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2tbz\" (UniqueName: \"kubernetes.io/projected/eff1de51-f778-4b69-a334-730a35ee4e4f-kube-api-access-t2tbz\") pod \"eff1de51-f778-4b69-a334-730a35ee4e4f\" (UID: \"eff1de51-f778-4b69-a334-730a35ee4e4f\") "
Sep 19 15:42:18.770850 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.770830    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eff1de51-f778-4b69-a334-730a35ee4e4f-kube-api-access-t2tbz" (OuterVolumeSpecName: "kube-api-access-t2tbz") pod "eff1de51-f778-4b69-a334-730a35ee4e4f" (UID: "eff1de51-f778-4b69-a334-730a35ee4e4f"). InnerVolumeSpecName "kube-api-access-t2tbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:42:18.869905 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:18.869868    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2tbz\" (UniqueName: \"kubernetes.io/projected/eff1de51-f778-4b69-a334-730a35ee4e4f-kube-api-access-t2tbz\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:19.087588 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:19.087498    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:19.155430 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:19.155398    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"]
Sep 19 15:42:19.180031 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:19.180000    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:19.345567 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:19.345489    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eff1de51-f778-4b69-a334-730a35ee4e4f" path="/var/lib/kubelet/pods/eff1de51-f778-4b69-a334-730a35ee4e4f/volumes"
Sep 19 15:42:19.561046 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:19.561020    2562 generic.go:356] "Generic (PLEG): container finished" podID="eff1de51-f778-4b69-a334-730a35ee4e4f" containerID="b0df508f96972aed001be7d8dfae5a6c9a318315c2fd75cb7dc648b4ec9e7cce" exitCode=137
Sep 19 15:42:19.561462 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:19.561064    2562 scope.go:117] "RemoveContainer" containerID="b0df508f96972aed001be7d8dfae5a6c9a318315c2fd75cb7dc648b4ec9e7cce"
Sep 19 15:42:19.561462 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:19.561066    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9292-d38529"
Sep 19 15:42:19.562928 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:19.562901    2562 generic.go:356] "Generic (PLEG): container finished" podID="38db3e96-bb11-4d9d-b7b4-39b26916df90" containerID="45078eb6d3b51ac2b159e4c835a913e9160a05d3e7ed066bfb55a1c275cbe40a" exitCode=0
Sep 19 15:42:19.563047 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:19.562968    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg" event={"ID":"38db3e96-bb11-4d9d-b7b4-39b26916df90","Type":"ContainerDied","Data":"45078eb6d3b51ac2b159e4c835a913e9160a05d3e7ed066bfb55a1c275cbe40a"}
Sep 19 15:42:19.563047 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:19.563028    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg" event={"ID":"38db3e96-bb11-4d9d-b7b4-39b26916df90","Type":"ContainerStarted","Data":"589e9ce03ff1f06eba2ee60dd6b7d200b13f0786b7c95e8d0877c0aad94a76f4"}
Sep 19 15:42:19.570189 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:19.570173    2562 scope.go:117] "RemoveContainer" containerID="b0df508f96972aed001be7d8dfae5a6c9a318315c2fd75cb7dc648b4ec9e7cce"
Sep 19 15:42:19.570490 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:42:19.570473    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0df508f96972aed001be7d8dfae5a6c9a318315c2fd75cb7dc648b4ec9e7cce\": container with ID starting with b0df508f96972aed001be7d8dfae5a6c9a318315c2fd75cb7dc648b4ec9e7cce not found: ID does not exist" containerID="b0df508f96972aed001be7d8dfae5a6c9a318315c2fd75cb7dc648b4ec9e7cce"
Sep 19 15:42:19.570544 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:19.570498    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0df508f96972aed001be7d8dfae5a6c9a318315c2fd75cb7dc648b4ec9e7cce"} err="failed to get container status \"b0df508f96972aed001be7d8dfae5a6c9a318315c2fd75cb7dc648b4ec9e7cce\": rpc error: code = NotFound desc = could not find container \"b0df508f96972aed001be7d8dfae5a6c9a318315c2fd75cb7dc648b4ec9e7cce\": container with ID starting with b0df508f96972aed001be7d8dfae5a6c9a318315c2fd75cb7dc648b4ec9e7cce not found: ID does not exist"
Sep 19 15:42:19.703231 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:19.703142    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:20.138312 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:20.138273    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"]
Sep 19 15:42:20.158625 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:20.158591    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:20.509841 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:20.509761    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:20.719653 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:20.719606    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg"
Sep 19 15:42:20.753903 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:20.753872    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9292-3de138"
Sep 19 15:42:20.790044 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:20.790019    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38db3e96-bb11-4d9d-b7b4-39b26916df90-maas-api-service-ca\") pod \"38db3e96-bb11-4d9d-b7b4-39b26916df90\" (UID: \"38db3e96-bb11-4d9d-b7b4-39b26916df90\") "
Sep 19 15:42:20.790388 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:20.790362    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38db3e96-bb11-4d9d-b7b4-39b26916df90-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "38db3e96-bb11-4d9d-b7b4-39b26916df90" (UID: "38db3e96-bb11-4d9d-b7b4-39b26916df90"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:42:20.891445 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:20.891421    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9v88m\" (UniqueName: \"kubernetes.io/projected/8474fdc3-c6ea-49a2-82ec-a50508fbe434-kube-api-access-9v88m\") pod \"8474fdc3-c6ea-49a2-82ec-a50508fbe434\" (UID: \"8474fdc3-c6ea-49a2-82ec-a50508fbe434\") "
Sep 19 15:42:20.891689 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:20.891676    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38db3e96-bb11-4d9d-b7b4-39b26916df90-maas-api-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:20.893718 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:20.893688    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8474fdc3-c6ea-49a2-82ec-a50508fbe434-kube-api-access-9v88m" (OuterVolumeSpecName: "kube-api-access-9v88m") pod "8474fdc3-c6ea-49a2-82ec-a50508fbe434" (UID: "8474fdc3-c6ea-49a2-82ec-a50508fbe434"). InnerVolumeSpecName "kube-api-access-9v88m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:42:20.993135 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:20.993111    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v88m\" (UniqueName: \"kubernetes.io/projected/8474fdc3-c6ea-49a2-82ec-a50508fbe434-kube-api-access-9v88m\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:21.167079 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:21.166999    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:21.344533 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:21.344502    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8474fdc3-c6ea-49a2-82ec-a50508fbe434" path="/var/lib/kubelet/pods/8474fdc3-c6ea-49a2-82ec-a50508fbe434/volumes"
Sep 19 15:42:21.412113 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:21.412083    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:21.511136 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:21.511060    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:21.575891 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:21.575865    2562 generic.go:356] "Generic (PLEG): container finished" podID="8474fdc3-c6ea-49a2-82ec-a50508fbe434" containerID="f8678f4a5af009766b221023d39ceef3856c2cc6b936b71e87aa05b5474b1443" exitCode=137
Sep 19 15:42:21.576056 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:21.575921    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9292-3de138"
Sep 19 15:42:21.576056 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:21.575968    2562 scope.go:117] "RemoveContainer" containerID="f8678f4a5af009766b221023d39ceef3856c2cc6b936b71e87aa05b5474b1443"
Sep 19 15:42:21.577618 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:21.577592    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg" event={"ID":"38db3e96-bb11-4d9d-b7b4-39b26916df90","Type":"ContainerDied","Data":"589e9ce03ff1f06eba2ee60dd6b7d200b13f0786b7c95e8d0877c0aad94a76f4"}
Sep 19 15:42:21.577618 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:21.577609    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg"
Sep 19 15:42:21.577858 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:21.577675    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="589e9ce03ff1f06eba2ee60dd6b7d200b13f0786b7c95e8d0877c0aad94a76f4"
Sep 19 15:42:21.585538 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:21.585520    2562 scope.go:117] "RemoveContainer" containerID="f8678f4a5af009766b221023d39ceef3856c2cc6b936b71e87aa05b5474b1443"
Sep 19 15:42:21.585807 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:42:21.585777    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8678f4a5af009766b221023d39ceef3856c2cc6b936b71e87aa05b5474b1443\": container with ID starting with f8678f4a5af009766b221023d39ceef3856c2cc6b936b71e87aa05b5474b1443 not found: ID does not exist" containerID="f8678f4a5af009766b221023d39ceef3856c2cc6b936b71e87aa05b5474b1443"
Sep 19 15:42:21.585909 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:21.585815    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8678f4a5af009766b221023d39ceef3856c2cc6b936b71e87aa05b5474b1443"} err="failed to get container status \"f8678f4a5af009766b221023d39ceef3856c2cc6b936b71e87aa05b5474b1443\": rpc error: code = NotFound desc = could not find container \"f8678f4a5af009766b221023d39ceef3856c2cc6b936b71e87aa05b5474b1443\": container with ID starting with f8678f4a5af009766b221023d39ceef3856c2cc6b936b71e87aa05b5474b1443 not found: ID does not exist"
Sep 19 15:42:21.811659 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:21.811629    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:22.581834 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:22.581799    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:23.201876 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:23.201845    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:29.799085 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:29.799052    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:32.934526 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:32.934497    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"]
Sep 19 15:42:32.934914 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:32.934901    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38db3e96-bb11-4d9d-b7b4-39b26916df90" containerName="revoke-keys"
Sep 19 15:42:32.934955 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:32.934915    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="38db3e96-bb11-4d9d-b7b4-39b26916df90" containerName="revoke-keys"
Sep 19 15:42:32.935009 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:32.934999    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="38db3e96-bb11-4d9d-b7b4-39b26916df90" containerName="revoke-keys"
Sep 19 15:42:32.937539 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:32.937523    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:32.939736 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:32.939711    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w2-50372a\"/\"rate-test-model-50372a-kserve-self-signed-certs\""
Sep 19 15:42:32.944863 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:32.944840    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"]
Sep 19 15:42:32.972462 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:32.972437    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:33.108456 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.108410    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk8r7\" (UniqueName: \"kubernetes.io/projected/eb907f49-56d3-4b68-966b-887954899625-kube-api-access-kk8r7\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.108808 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.108771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-home\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.109096 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.109072    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-model-cache\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.109247 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.109118    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb907f49-56d3-4b68-966b-887954899625-tls-certs\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.109247 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.109211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-tmp-dir\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.109377 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.109248    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-dshm\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.210778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.210703    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-tmp-dir\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.210778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.210737    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-dshm\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.210989 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.210782    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk8r7\" (UniqueName: \"kubernetes.io/projected/eb907f49-56d3-4b68-966b-887954899625-kube-api-access-kk8r7\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.210989 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.210813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-home\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.210989 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.210864    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-model-cache\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.210989 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.210898    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb907f49-56d3-4b68-966b-887954899625-tls-certs\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.211237 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.211179    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-tmp-dir\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.211295 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.211252    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-home\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.211332 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.211284    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-model-cache\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.213038 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.213022    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-dshm\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.213398 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.213382    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb907f49-56d3-4b68-966b-887954899625-tls-certs\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.218237 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.218219    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk8r7\" (UniqueName: \"kubernetes.io/projected/eb907f49-56d3-4b68-966b-887954899625-kube-api-access-kk8r7\") pod \"rate-test-model-50372a-kserve-b8565fc47-z8vfd\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") " pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.249098 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.249074    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:33.336026 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.335993    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:42:33.524899 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.524872    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"]
Sep 19 15:42:33.527618 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:42:33.527563    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb907f49_56d3_4b68_966b_887954899625.slice/crio-8d50a6f4b0bc3b785fb268f2f5fff16e8bcf19b52ef285857d3df17cbdb0e611 WatchSource:0}: Error finding container 8d50a6f4b0bc3b785fb268f2f5fff16e8bcf19b52ef285857d3df17cbdb0e611: Status 404 returned error can't find the container with id 8d50a6f4b0bc3b785fb268f2f5fff16e8bcf19b52ef285857d3df17cbdb0e611
Sep 19 15:42:33.646545 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.646510    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd" event={"ID":"eb907f49-56d3-4b68-966b-887954899625","Type":"ContainerStarted","Data":"e061aa2d0a9c2f3cc5925bcc94535ea456f846538954d313c310538d41770de5"}
Sep 19 15:42:33.646545 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.646554    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd" event={"ID":"eb907f49-56d3-4b68-966b-887954899625","Type":"ContainerStarted","Data":"8d50a6f4b0bc3b785fb268f2f5fff16e8bcf19b52ef285857d3df17cbdb0e611"}
Sep 19 15:42:33.660932 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.660879    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd" podStartSLOduration=1.660859343 podStartE2EDuration="1.660859343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:42:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:42:33.660368035 +0000 UTC m=+1816.823783076" watchObservedRunningTime="2026-09-19 15:42:33.660859343 +0000 UTC m=+1816.824274384"
Sep 19 15:42:33.737552 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.737525    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg"]
Sep 19 15:42:33.739500 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:33.739482    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-88b9ff-csdgg"]
Sep 19 15:42:34.015527 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.015498    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:34.121010 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.120976    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:34.174974 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.174945    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct" podUID="32a5ef07-713f-4198-8b99-929e0eef1c2d" containerName="main" containerID="cri-o://a393adf465c3fa0f0908e897bc60a1ffb51391701c07fe166a1270ee53688c0f" gracePeriod=45
Sep 19 15:42:34.247930 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.247901    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:34.428998 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.428973    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:42:34.524273 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.524246    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-home\") pod \"32a5ef07-713f-4198-8b99-929e0eef1c2d\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") "
Sep 19 15:42:34.524437 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.524310    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32a5ef07-713f-4198-8b99-929e0eef1c2d-tls-certs\") pod \"32a5ef07-713f-4198-8b99-929e0eef1c2d\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") "
Sep 19 15:42:34.524437 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.524385    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-tmp-dir\") pod \"32a5ef07-713f-4198-8b99-929e0eef1c2d\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") "
Sep 19 15:42:34.524437 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.524424    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5vmd\" (UniqueName: \"kubernetes.io/projected/32a5ef07-713f-4198-8b99-929e0eef1c2d-kube-api-access-s5vmd\") pod \"32a5ef07-713f-4198-8b99-929e0eef1c2d\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") "
Sep 19 15:42:34.524617 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.524465    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-model-cache\") pod \"32a5ef07-713f-4198-8b99-929e0eef1c2d\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") "
Sep 19 15:42:34.524617 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.524484    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-home" (OuterVolumeSpecName: "home") pod "32a5ef07-713f-4198-8b99-929e0eef1c2d" (UID: "32a5ef07-713f-4198-8b99-929e0eef1c2d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:42:34.524617 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.524501    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-dshm\") pod \"32a5ef07-713f-4198-8b99-929e0eef1c2d\" (UID: \"32a5ef07-713f-4198-8b99-929e0eef1c2d\") "
Sep 19 15:42:34.524809 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.524679    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "32a5ef07-713f-4198-8b99-929e0eef1c2d" (UID: "32a5ef07-713f-4198-8b99-929e0eef1c2d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:42:34.524952 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.524929    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-tmp-dir\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:34.525034 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.524957    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-home\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:34.525144 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.525105    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-model-cache" (OuterVolumeSpecName: "model-cache") pod "32a5ef07-713f-4198-8b99-929e0eef1c2d" (UID: "32a5ef07-713f-4198-8b99-929e0eef1c2d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:42:34.526597 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.526575    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32a5ef07-713f-4198-8b99-929e0eef1c2d-kube-api-access-s5vmd" (OuterVolumeSpecName: "kube-api-access-s5vmd") pod "32a5ef07-713f-4198-8b99-929e0eef1c2d" (UID: "32a5ef07-713f-4198-8b99-929e0eef1c2d"). InnerVolumeSpecName "kube-api-access-s5vmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:42:34.527147 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.527123    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32a5ef07-713f-4198-8b99-929e0eef1c2d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "32a5ef07-713f-4198-8b99-929e0eef1c2d" (UID: "32a5ef07-713f-4198-8b99-929e0eef1c2d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:42:34.527253 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.527123    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-dshm" (OuterVolumeSpecName: "dshm") pod "32a5ef07-713f-4198-8b99-929e0eef1c2d" (UID: "32a5ef07-713f-4198-8b99-929e0eef1c2d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:42:34.626462 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.626399    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-dshm\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:34.626462 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.626420    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32a5ef07-713f-4198-8b99-929e0eef1c2d-tls-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:34.626462 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.626429    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5vmd\" (UniqueName: \"kubernetes.io/projected/32a5ef07-713f-4198-8b99-929e0eef1c2d-kube-api-access-s5vmd\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:34.626462 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.626437    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32a5ef07-713f-4198-8b99-929e0eef1c2d-model-cache\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:34.654054 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.654028    2562 generic.go:356] "Generic (PLEG): container finished" podID="32a5ef07-713f-4198-8b99-929e0eef1c2d" containerID="a393adf465c3fa0f0908e897bc60a1ffb51391701c07fe166a1270ee53688c0f" exitCode=0
Sep 19 15:42:34.654166 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.654071    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"
Sep 19 15:42:34.654166 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.654110    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct" event={"ID":"32a5ef07-713f-4198-8b99-929e0eef1c2d","Type":"ContainerDied","Data":"a393adf465c3fa0f0908e897bc60a1ffb51391701c07fe166a1270ee53688c0f"}
Sep 19 15:42:34.654166 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.654145    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct" event={"ID":"32a5ef07-713f-4198-8b99-929e0eef1c2d","Type":"ContainerDied","Data":"4ce0d13f03f764c642c414b9d1e2c2092656afcbe8b2da2d899a6721410de6e0"}
Sep 19 15:42:34.654166 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.654162    2562 scope.go:117] "RemoveContainer" containerID="a393adf465c3fa0f0908e897bc60a1ffb51391701c07fe166a1270ee53688c0f"
Sep 19 15:42:34.664132 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.664116    2562 scope.go:117] "RemoveContainer" containerID="a393adf465c3fa0f0908e897bc60a1ffb51391701c07fe166a1270ee53688c0f"
Sep 19 15:42:34.664409 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:42:34.664391    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a393adf465c3fa0f0908e897bc60a1ffb51391701c07fe166a1270ee53688c0f\": container with ID starting with a393adf465c3fa0f0908e897bc60a1ffb51391701c07fe166a1270ee53688c0f not found: ID does not exist" containerID="a393adf465c3fa0f0908e897bc60a1ffb51391701c07fe166a1270ee53688c0f"
Sep 19 15:42:34.664477 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.664415    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a393adf465c3fa0f0908e897bc60a1ffb51391701c07fe166a1270ee53688c0f"} err="failed to get container status \"a393adf465c3fa0f0908e897bc60a1ffb51391701c07fe166a1270ee53688c0f\": rpc error: code = NotFound desc = could not find container \"a393adf465c3fa0f0908e897bc60a1ffb51391701c07fe166a1270ee53688c0f\": container with ID starting with a393adf465c3fa0f0908e897bc60a1ffb51391701c07fe166a1270ee53688c0f not found: ID does not exist"
Sep 19 15:42:34.675018 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.674998    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"]
Sep 19 15:42:34.677934 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.677912    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/sub-test-model-50372a-kserve-6fc8fc4bcf-whzct"]
Sep 19 15:42:34.879925 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:34.879834    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:35.158609 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.158499    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d" podUID="2e23461e-da8e-400a-9672-ba1bd77c9580" containerName="main" containerID="cri-o://82e8511cc9ad95e04bb092cb7aaa617b5233638e1c733b45cafeeface4720ed3" gracePeriod=45
Sep 19 15:42:35.348897 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.348865    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32a5ef07-713f-4198-8b99-929e0eef1c2d" path="/var/lib/kubelet/pods/32a5ef07-713f-4198-8b99-929e0eef1c2d/volumes"
Sep 19 15:42:35.349416 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.349393    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38db3e96-bb11-4d9d-b7b4-39b26916df90" path="/var/lib/kubelet/pods/38db3e96-bb11-4d9d-b7b4-39b26916df90/volumes"
Sep 19 15:42:35.404852 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.404833    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:42:35.433658 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.433604    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e23461e-da8e-400a-9672-ba1bd77c9580-tls-certs\") pod \"2e23461e-da8e-400a-9672-ba1bd77c9580\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") "
Sep 19 15:42:35.433658 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.433638    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klplg\" (UniqueName: \"kubernetes.io/projected/2e23461e-da8e-400a-9672-ba1bd77c9580-kube-api-access-klplg\") pod \"2e23461e-da8e-400a-9672-ba1bd77c9580\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") "
Sep 19 15:42:35.433839 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.433669    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-model-cache\") pod \"2e23461e-da8e-400a-9672-ba1bd77c9580\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") "
Sep 19 15:42:35.433839 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.433685    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-home\") pod \"2e23461e-da8e-400a-9672-ba1bd77c9580\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") "
Sep 19 15:42:35.433839 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.433746    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-dshm\") pod \"2e23461e-da8e-400a-9672-ba1bd77c9580\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") "
Sep 19 15:42:35.433839 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.433803    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-tmp-dir\") pod \"2e23461e-da8e-400a-9672-ba1bd77c9580\" (UID: \"2e23461e-da8e-400a-9672-ba1bd77c9580\") "
Sep 19 15:42:35.434056 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.433957    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-model-cache" (OuterVolumeSpecName: "model-cache") pod "2e23461e-da8e-400a-9672-ba1bd77c9580" (UID: "2e23461e-da8e-400a-9672-ba1bd77c9580"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:42:35.434056 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.433972    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-home" (OuterVolumeSpecName: "home") pod "2e23461e-da8e-400a-9672-ba1bd77c9580" (UID: "2e23461e-da8e-400a-9672-ba1bd77c9580"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:42:35.434231 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.434189    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2e23461e-da8e-400a-9672-ba1bd77c9580" (UID: "2e23461e-da8e-400a-9672-ba1bd77c9580"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:42:35.434556 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.434538    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-model-cache\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:35.434697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.434560    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-home\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:35.434697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.434574    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-tmp-dir\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:35.436072 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.436040    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-dshm" (OuterVolumeSpecName: "dshm") pod "2e23461e-da8e-400a-9672-ba1bd77c9580" (UID: "2e23461e-da8e-400a-9672-ba1bd77c9580"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:42:35.436162 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.436109    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e23461e-da8e-400a-9672-ba1bd77c9580-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2e23461e-da8e-400a-9672-ba1bd77c9580" (UID: "2e23461e-da8e-400a-9672-ba1bd77c9580"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:42:35.436162 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.436134    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e23461e-da8e-400a-9672-ba1bd77c9580-kube-api-access-klplg" (OuterVolumeSpecName: "kube-api-access-klplg") pod "2e23461e-da8e-400a-9672-ba1bd77c9580" (UID: "2e23461e-da8e-400a-9672-ba1bd77c9580"). InnerVolumeSpecName "kube-api-access-klplg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:42:35.535784 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.535757    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e23461e-da8e-400a-9672-ba1bd77c9580-dshm\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:35.535784 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.535782    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e23461e-da8e-400a-9672-ba1bd77c9580-tls-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:35.535949 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.535792    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klplg\" (UniqueName: \"kubernetes.io/projected/2e23461e-da8e-400a-9672-ba1bd77c9580-kube-api-access-klplg\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:35.661610 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.661578    2562 generic.go:356] "Generic (PLEG): container finished" podID="2e23461e-da8e-400a-9672-ba1bd77c9580" containerID="82e8511cc9ad95e04bb092cb7aaa617b5233638e1c733b45cafeeface4720ed3" exitCode=0
Sep 19 15:42:35.661779 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.661621    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"
Sep 19 15:42:35.661779 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.661668    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d" event={"ID":"2e23461e-da8e-400a-9672-ba1bd77c9580","Type":"ContainerDied","Data":"82e8511cc9ad95e04bb092cb7aaa617b5233638e1c733b45cafeeface4720ed3"}
Sep 19 15:42:35.661779 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.661708    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d" event={"ID":"2e23461e-da8e-400a-9672-ba1bd77c9580","Type":"ContainerDied","Data":"d4a84fc1b69afbcee085414b2c4266ef78c74d2588a3579586114c7bca613bcd"}
Sep 19 15:42:35.661779 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.661724    2562 scope.go:117] "RemoveContainer" containerID="82e8511cc9ad95e04bb092cb7aaa617b5233638e1c733b45cafeeface4720ed3"
Sep 19 15:42:35.664103 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.664077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:35.671557 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.671542    2562 scope.go:117] "RemoveContainer" containerID="82e8511cc9ad95e04bb092cb7aaa617b5233638e1c733b45cafeeface4720ed3"
Sep 19 15:42:35.671832 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:42:35.671812    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82e8511cc9ad95e04bb092cb7aaa617b5233638e1c733b45cafeeface4720ed3\": container with ID starting with 82e8511cc9ad95e04bb092cb7aaa617b5233638e1c733b45cafeeface4720ed3 not found: ID does not exist" containerID="82e8511cc9ad95e04bb092cb7aaa617b5233638e1c733b45cafeeface4720ed3"
Sep 19 15:42:35.671890 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.671840    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e8511cc9ad95e04bb092cb7aaa617b5233638e1c733b45cafeeface4720ed3"} err="failed to get container status \"82e8511cc9ad95e04bb092cb7aaa617b5233638e1c733b45cafeeface4720ed3\": rpc error: code = NotFound desc = could not find container \"82e8511cc9ad95e04bb092cb7aaa617b5233638e1c733b45cafeeface4720ed3\": container with ID starting with 82e8511cc9ad95e04bb092cb7aaa617b5233638e1c733b45cafeeface4720ed3 not found: ID does not exist"
Sep 19 15:42:35.684927 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.684876    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"]
Sep 19 15:42:35.688160 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:35.688138    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w2-f9c5c2/sub-test-model-f9c5c2-kserve-bdfdbfb87-dxz8d"]
Sep 19 15:42:36.400957 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:36.400924    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:36.942663 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:36.942627    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:37.346563 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:37.346529    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e23461e-da8e-400a-9672-ba1bd77c9580" path="/var/lib/kubelet/pods/2e23461e-da8e-400a-9672-ba1bd77c9580/volumes"
Sep 19 15:42:37.767326 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:37.767222    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:40.384181 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:40.384152    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:40.483999 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:40.483969    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:40.694318 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:40.694231    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"]
Sep 19 15:42:40.694517 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:40.694491    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh" podUID="c673305b-431c-4607-8802-4fbbc3370c46" containerName="istio-proxy" containerID="cri-o://c3cc5a8567145f1f2c396eb21d12b456e602e8d4ea92dbd9c6cfeead81b61a7d" gracePeriod=30
Sep 19 15:42:40.714114 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:40.714064    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:41.010218 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.010119    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s"]
Sep 19 15:42:41.010684 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.010664    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e23461e-da8e-400a-9672-ba1bd77c9580" containerName="main"
Sep 19 15:42:41.010791 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.010685    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e23461e-da8e-400a-9672-ba1bd77c9580" containerName="main"
Sep 19 15:42:41.010791 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.010722    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32a5ef07-713f-4198-8b99-929e0eef1c2d" containerName="main"
Sep 19 15:42:41.010791 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.010730    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="32a5ef07-713f-4198-8b99-929e0eef1c2d" containerName="main"
Sep 19 15:42:41.010940 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.010828    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="32a5ef07-713f-4198-8b99-929e0eef1c2d" containerName="main"
Sep 19 15:42:41.010940 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.010849    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e23461e-da8e-400a-9672-ba1bd77c9580" containerName="main"
Sep 19 15:42:41.013774 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.013752    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s"
Sep 19 15:42:41.016048 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.016023    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7znsl\""
Sep 19 15:42:41.016140 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.016062    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 15:42:41.021151 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.021126    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s"]
Sep 19 15:42:41.085448 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.085414    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a6b1e95-f9b8-4448-a0a3-989575e492fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s\" (UID: \"1a6b1e95-f9b8-4448-a0a3-989575e492fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s"
Sep 19 15:42:41.186744 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.186716    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a6b1e95-f9b8-4448-a0a3-989575e492fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s\" (UID: \"1a6b1e95-f9b8-4448-a0a3-989575e492fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s"
Sep 19 15:42:41.187303 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.187284    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a6b1e95-f9b8-4448-a0a3-989575e492fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s\" (UID: \"1a6b1e95-f9b8-4448-a0a3-989575e492fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s"
Sep 19 15:42:41.325483 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.325448    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s"
Sep 19 15:42:41.358299 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.358266    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:41.594929 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.594902    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s"]
Sep 19 15:42:41.597417 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:42:41.597389    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a6b1e95_f9b8_4448_a0a3_989575e492fb.slice/crio-3c210914c8503d7bd6c301e2a4ca7b62d090d3b0ce3b39631422b6d12bbf7645 WatchSource:0}: Error finding container 3c210914c8503d7bd6c301e2a4ca7b62d090d3b0ce3b39631422b6d12bbf7645: Status 404 returned error can't find the container with id 3c210914c8503d7bd6c301e2a4ca7b62d090d3b0ce3b39631422b6d12bbf7645
Sep 19 15:42:41.700747 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.700712    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s" event={"ID":"1a6b1e95-f9b8-4448-a0a3-989575e492fb","Type":"ContainerStarted","Data":"3c210914c8503d7bd6c301e2a4ca7b62d090d3b0ce3b39631422b6d12bbf7645"}
Sep 19 15:42:41.943790 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:41.943741    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:42.661006 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:42.660923    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:42.708273 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:42.708243    2562 generic.go:356] "Generic (PLEG): container finished" podID="1a6b1e95-f9b8-4448-a0a3-989575e492fb" containerID="ed4b1c917480c3ce8ffa70ec3fb966ff5dfdb221b4e9ca7524f3c89690604ab0" exitCode=0
Sep 19 15:42:42.708428 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:42.708338    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s" event={"ID":"1a6b1e95-f9b8-4448-a0a3-989575e492fb","Type":"ContainerDied","Data":"ed4b1c917480c3ce8ffa70ec3fb966ff5dfdb221b4e9ca7524f3c89690604ab0"}
Sep 19 15:42:43.249528 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:43.249499    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:43.249711 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:43.249542    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:43.262222 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:43.262179    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:43.288555 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:43.288529    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:43.724972 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:43.724946    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:42:43.856723 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:43.856697    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s"
Sep 19 15:42:43.915564 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:43.915533    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a6b1e95-f9b8-4448-a0a3-989575e492fb-maas-api-service-ca\") pod \"1a6b1e95-f9b8-4448-a0a3-989575e492fb\" (UID: \"1a6b1e95-f9b8-4448-a0a3-989575e492fb\") "
Sep 19 15:42:43.915923 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:43.915888    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a6b1e95-f9b8-4448-a0a3-989575e492fb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1a6b1e95-f9b8-4448-a0a3-989575e492fb" (UID: "1a6b1e95-f9b8-4448-a0a3-989575e492fb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:42:43.970158 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:43.970076    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:44.016433 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:44.016400    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a6b1e95-f9b8-4448-a0a3-989575e492fb-maas-api-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:44.717362 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:44.717330    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:44.720365 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:44.720343    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s"
Sep 19 15:42:44.720489 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:44.720383    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s" event={"ID":"1a6b1e95-f9b8-4448-a0a3-989575e492fb","Type":"ContainerDied","Data":"3c210914c8503d7bd6c301e2a4ca7b62d090d3b0ce3b39631422b6d12bbf7645"}
Sep 19 15:42:44.720489 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:44.720434    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c210914c8503d7bd6c301e2a4ca7b62d090d3b0ce3b39631422b6d12bbf7645"
Sep 19 15:42:45.345873 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:45.345840    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:45.743158 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:45.743133    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:42:45.951893 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:45.951874    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:42:46.035641 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.035610    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c673305b-431c-4607-8802-4fbbc3370c46-istio-token\") pod \"c673305b-431c-4607-8802-4fbbc3370c46\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") "
Sep 19 15:42:46.035805 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.035667    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-istio-envoy\") pod \"c673305b-431c-4607-8802-4fbbc3370c46\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") "
Sep 19 15:42:46.035805 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.035703    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-workload-certs\") pod \"c673305b-431c-4607-8802-4fbbc3370c46\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") "
Sep 19 15:42:46.035805 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.035728    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2wnx\" (UniqueName: \"kubernetes.io/projected/c673305b-431c-4607-8802-4fbbc3370c46-kube-api-access-g2wnx\") pod \"c673305b-431c-4607-8802-4fbbc3370c46\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") "
Sep 19 15:42:46.035805 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.035745    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c673305b-431c-4607-8802-4fbbc3370c46-istiod-ca-cert\") pod \"c673305b-431c-4607-8802-4fbbc3370c46\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") "
Sep 19 15:42:46.035805 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.035764    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c673305b-431c-4607-8802-4fbbc3370c46-istio-podinfo\") pod \"c673305b-431c-4607-8802-4fbbc3370c46\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") "
Sep 19 15:42:46.036059 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.035812    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-credential-socket\") pod \"c673305b-431c-4607-8802-4fbbc3370c46\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") "
Sep 19 15:42:46.036059 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.035876    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-workload-socket\") pod \"c673305b-431c-4607-8802-4fbbc3370c46\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") "
Sep 19 15:42:46.036059 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.035917    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-istio-data\") pod \"c673305b-431c-4607-8802-4fbbc3370c46\" (UID: \"c673305b-431c-4607-8802-4fbbc3370c46\") "
Sep 19 15:42:46.036059 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.036022    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c673305b-431c-4607-8802-4fbbc3370c46" (UID: "c673305b-431c-4607-8802-4fbbc3370c46"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:42:46.036310 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.036227    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c673305b-431c-4607-8802-4fbbc3370c46" (UID: "c673305b-431c-4607-8802-4fbbc3370c46"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:42:46.036372 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.036305    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c673305b-431c-4607-8802-4fbbc3370c46-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c673305b-431c-4607-8802-4fbbc3370c46" (UID: "c673305b-431c-4607-8802-4fbbc3370c46"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:42:46.036480 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.036455    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-istio-data" (OuterVolumeSpecName: "istio-data") pod "c673305b-431c-4607-8802-4fbbc3370c46" (UID: "c673305b-431c-4607-8802-4fbbc3370c46"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:42:46.036546 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.036473    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c673305b-431c-4607-8802-4fbbc3370c46" (UID: "c673305b-431c-4607-8802-4fbbc3370c46"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:42:46.036546 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.036528    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:46.036546 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.036542    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c673305b-431c-4607-8802-4fbbc3370c46-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:46.036644 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.036550    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:46.038642 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.038605    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c673305b-431c-4607-8802-4fbbc3370c46-kube-api-access-g2wnx" (OuterVolumeSpecName: "kube-api-access-g2wnx") pod "c673305b-431c-4607-8802-4fbbc3370c46" (UID: "c673305b-431c-4607-8802-4fbbc3370c46"). InnerVolumeSpecName "kube-api-access-g2wnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:42:46.038642 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.038605    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c673305b-431c-4607-8802-4fbbc3370c46-istio-token" (OuterVolumeSpecName: "istio-token") pod "c673305b-431c-4607-8802-4fbbc3370c46" (UID: "c673305b-431c-4607-8802-4fbbc3370c46"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:42:46.038835 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.038693    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c673305b-431c-4607-8802-4fbbc3370c46-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c673305b-431c-4607-8802-4fbbc3370c46" (UID: "c673305b-431c-4607-8802-4fbbc3370c46"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:42:46.038835 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.038697    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c673305b-431c-4607-8802-4fbbc3370c46" (UID: "c673305b-431c-4607-8802-4fbbc3370c46"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:42:46.137490 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.137460    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:46.137490 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.137487    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2wnx\" (UniqueName: \"kubernetes.io/projected/c673305b-431c-4607-8802-4fbbc3370c46-kube-api-access-g2wnx\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:46.137490 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.137496    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c673305b-431c-4607-8802-4fbbc3370c46-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:46.137745 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.137505    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:46.137745 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.137515    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c673305b-431c-4607-8802-4fbbc3370c46-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:46.137745 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.137522    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c673305b-431c-4607-8802-4fbbc3370c46-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:42:46.733383 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.733346    2562 generic.go:356] "Generic (PLEG): container finished" podID="c673305b-431c-4607-8802-4fbbc3370c46" containerID="c3cc5a8567145f1f2c396eb21d12b456e602e8d4ea92dbd9c6cfeead81b61a7d" exitCode=0
Sep 19 15:42:46.733808 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.733394    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"
Sep 19 15:42:46.733808 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.733428    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh" event={"ID":"c673305b-431c-4607-8802-4fbbc3370c46","Type":"ContainerDied","Data":"c3cc5a8567145f1f2c396eb21d12b456e602e8d4ea92dbd9c6cfeead81b61a7d"}
Sep 19 15:42:46.733808 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.733479    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh" event={"ID":"c673305b-431c-4607-8802-4fbbc3370c46","Type":"ContainerDied","Data":"4a7789602268ceb690b1033c44aa9ea3299c166cb382c50af9665da1956f3042"}
Sep 19 15:42:46.733808 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.733507    2562 scope.go:117] "RemoveContainer" containerID="c3cc5a8567145f1f2c396eb21d12b456e602e8d4ea92dbd9c6cfeead81b61a7d"
Sep 19 15:42:46.743604 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.743587    2562 scope.go:117] "RemoveContainer" containerID="5d98c9c3bcde195a065ca8b60906e105f4afa402eabf020ff6743c9dfa523b86"
Sep 19 15:42:46.751697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.751675    2562 scope.go:117] "RemoveContainer" containerID="c3cc5a8567145f1f2c396eb21d12b456e602e8d4ea92dbd9c6cfeead81b61a7d"
Sep 19 15:42:46.752176 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:42:46.752150    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3cc5a8567145f1f2c396eb21d12b456e602e8d4ea92dbd9c6cfeead81b61a7d\": container with ID starting with c3cc5a8567145f1f2c396eb21d12b456e602e8d4ea92dbd9c6cfeead81b61a7d not found: ID does not exist" containerID="c3cc5a8567145f1f2c396eb21d12b456e602e8d4ea92dbd9c6cfeead81b61a7d"
Sep 19 15:42:46.752311 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.752185    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3cc5a8567145f1f2c396eb21d12b456e602e8d4ea92dbd9c6cfeead81b61a7d"} err="failed to get container status \"c3cc5a8567145f1f2c396eb21d12b456e602e8d4ea92dbd9c6cfeead81b61a7d\": rpc error: code = NotFound desc = could not find container \"c3cc5a8567145f1f2c396eb21d12b456e602e8d4ea92dbd9c6cfeead81b61a7d\": container with ID starting with c3cc5a8567145f1f2c396eb21d12b456e602e8d4ea92dbd9c6cfeead81b61a7d not found: ID does not exist"
Sep 19 15:42:46.752311 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.752230    2562 scope.go:117] "RemoveContainer" containerID="5d98c9c3bcde195a065ca8b60906e105f4afa402eabf020ff6743c9dfa523b86"
Sep 19 15:42:46.752568 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:42:46.752541    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d98c9c3bcde195a065ca8b60906e105f4afa402eabf020ff6743c9dfa523b86\": container with ID starting with 5d98c9c3bcde195a065ca8b60906e105f4afa402eabf020ff6743c9dfa523b86 not found: ID does not exist" containerID="5d98c9c3bcde195a065ca8b60906e105f4afa402eabf020ff6743c9dfa523b86"
Sep 19 15:42:46.752664 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.752577    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d98c9c3bcde195a065ca8b60906e105f4afa402eabf020ff6743c9dfa523b86"} err="failed to get container status \"5d98c9c3bcde195a065ca8b60906e105f4afa402eabf020ff6743c9dfa523b86\": rpc error: code = NotFound desc = could not find container \"5d98c9c3bcde195a065ca8b60906e105f4afa402eabf020ff6743c9dfa523b86\": container with ID starting with 5d98c9c3bcde195a065ca8b60906e105f4afa402eabf020ff6743c9dfa523b86 not found: ID does not exist"
Sep 19 15:42:46.754762 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.754743    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"]
Sep 19 15:42:46.759776 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:46.759759    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh"]
Sep 19 15:42:47.346405 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:47.346372    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c673305b-431c-4607-8802-4fbbc3370c46" path="/var/lib/kubelet/pods/c673305b-431c-4607-8802-4fbbc3370c46/volumes"
Sep 19 15:42:56.533035 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:56.533002    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:56.634633 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:56.634601    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:56.697210 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:56.697166    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s"]
Sep 19 15:42:56.701692 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:56.701664    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:56.702105 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:56.702088    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-26cbe6-dhd6s"]
Sep 19 15:42:56.758540 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:56.758514    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:57.033570 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:57.033535    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:57.091418 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:57.091388    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:57.345103 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:57.345025    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a6b1e95-f9b8-4448-a0a3-989575e492fb" path="/var/lib/kubelet/pods/1a6b1e95-f9b8-4448-a0a3-989575e492fb/volumes"
Sep 19 15:42:57.751426 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:57.751335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:58.358416 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:58.358370    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:59.174703 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:59.174649    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:42:59.780363 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:42:59.780326    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:01.137483 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:01.137449    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:43:02.862688 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:02.862643    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:02.919256 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:02.919185    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:03.104038 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.104004    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"]
Sep 19 15:43:03.104342 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.104308    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r" podUID="1b45e88a-5449-4400-a701-4b4af33c233b" containerName="istio-proxy" containerID="cri-o://778f6ee72a3252870e32ae4f86434d26408ee3fe25a87a16feb7e0ce82919ad6" gracePeriod=30
Sep 19 15:43:03.125707 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.125648    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:03.443629 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.443556    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw"]
Sep 19 15:43:03.443977 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.443966    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a6b1e95-f9b8-4448-a0a3-989575e492fb" containerName="revoke-keys"
Sep 19 15:43:03.444018 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.443979    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a6b1e95-f9b8-4448-a0a3-989575e492fb" containerName="revoke-keys"
Sep 19 15:43:03.444018 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.443990    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c673305b-431c-4607-8802-4fbbc3370c46" containerName="istio-proxy"
Sep 19 15:43:03.444018 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.443995    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c673305b-431c-4607-8802-4fbbc3370c46" containerName="istio-proxy"
Sep 19 15:43:03.444111 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.444069    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c673305b-431c-4607-8802-4fbbc3370c46" containerName="istio-proxy"
Sep 19 15:43:03.444111 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.444077    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a6b1e95-f9b8-4448-a0a3-989575e492fb" containerName="revoke-keys"
Sep 19 15:43:03.446132 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.446117    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw"
Sep 19 15:43:03.448117 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.448095    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7znsl\""
Sep 19 15:43:03.448265 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.448099    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 15:43:03.453940 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.453635    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw"]
Sep 19 15:43:03.606551 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.606519    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/853acbee-b8ee-43a1-baf6-b0110953c137-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw\" (UID: \"853acbee-b8ee-43a1-baf6-b0110953c137\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw"
Sep 19 15:43:03.708131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.708050    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/853acbee-b8ee-43a1-baf6-b0110953c137-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw\" (UID: \"853acbee-b8ee-43a1-baf6-b0110953c137\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw"
Sep 19 15:43:03.708678 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.708655    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/853acbee-b8ee-43a1-baf6-b0110953c137-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw\" (UID: \"853acbee-b8ee-43a1-baf6-b0110953c137\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw"
Sep 19 15:43:03.756792 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.756762    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:03.758316 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:03.758300    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw"
Sep 19 15:43:04.032367 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:04.032343    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw"]
Sep 19 15:43:04.034385 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:43:04.034357    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853acbee_b8ee_43a1_baf6_b0110953c137.slice/crio-fec5cc165ed8605eedeacfa4d5d03c4c90c8fde9ee3dbcf906656aed60de883a WatchSource:0}: Error finding container fec5cc165ed8605eedeacfa4d5d03c4c90c8fde9ee3dbcf906656aed60de883a: Status 404 returned error can't find the container with id fec5cc165ed8605eedeacfa4d5d03c4c90c8fde9ee3dbcf906656aed60de883a
Sep 19 15:43:04.356625 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:04.356600    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:04.845702 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:04.845674    2562 generic.go:356] "Generic (PLEG): container finished" podID="853acbee-b8ee-43a1-baf6-b0110953c137" containerID="ca0fe49b25a4232447897c7ae0587cf100fcce110295e98eb26ca07814e32823" exitCode=0
Sep 19 15:43:04.845866 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:04.845787    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw" event={"ID":"853acbee-b8ee-43a1-baf6-b0110953c137","Type":"ContainerDied","Data":"ca0fe49b25a4232447897c7ae0587cf100fcce110295e98eb26ca07814e32823"}
Sep 19 15:43:04.845866 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:04.845824    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw" event={"ID":"853acbee-b8ee-43a1-baf6-b0110953c137","Type":"ContainerStarted","Data":"fec5cc165ed8605eedeacfa4d5d03c4c90c8fde9ee3dbcf906656aed60de883a"}
Sep 19 15:43:05.038566 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:05.038473    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:05.484477 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:05.484383    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:05.771753 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:05.771668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:05.985468 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:05.985446    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw"
Sep 19 15:43:06.134721 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:06.134693    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/853acbee-b8ee-43a1-baf6-b0110953c137-maas-api-service-ca\") pod \"853acbee-b8ee-43a1-baf6-b0110953c137\" (UID: \"853acbee-b8ee-43a1-baf6-b0110953c137\") "
Sep 19 15:43:06.135092 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:06.135023    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/853acbee-b8ee-43a1-baf6-b0110953c137-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "853acbee-b8ee-43a1-baf6-b0110953c137" (UID: "853acbee-b8ee-43a1-baf6-b0110953c137"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:43:06.235896 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:06.235859    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/853acbee-b8ee-43a1-baf6-b0110953c137-maas-api-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:06.301619 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:06.301589    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:06.858156 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:06.858131    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw"
Sep 19 15:43:06.858352 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:06.858170    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw" event={"ID":"853acbee-b8ee-43a1-baf6-b0110953c137","Type":"ContainerDied","Data":"fec5cc165ed8605eedeacfa4d5d03c4c90c8fde9ee3dbcf906656aed60de883a"}
Sep 19 15:43:06.858352 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:06.858229    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fec5cc165ed8605eedeacfa4d5d03c4c90c8fde9ee3dbcf906656aed60de883a"
Sep 19 15:43:07.059848 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:07.059816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:08.362264 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.362240    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:43:08.462888 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.462799    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b45e88a-5449-4400-a701-4b4af33c233b-istio-token\") pod \"1b45e88a-5449-4400-a701-4b4af33c233b\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") "
Sep 19 15:43:08.462888 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.462864    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-workload-socket\") pod \"1b45e88a-5449-4400-a701-4b4af33c233b\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") "
Sep 19 15:43:08.462888 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.462890    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-credential-socket\") pod \"1b45e88a-5449-4400-a701-4b4af33c233b\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") "
Sep 19 15:43:08.463147 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.462921    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-workload-certs\") pod \"1b45e88a-5449-4400-a701-4b4af33c233b\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") "
Sep 19 15:43:08.463147 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.462937    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b45e88a-5449-4400-a701-4b4af33c233b-istiod-ca-cert\") pod \"1b45e88a-5449-4400-a701-4b4af33c233b\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") "
Sep 19 15:43:08.463147 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.462982    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-istio-envoy\") pod \"1b45e88a-5449-4400-a701-4b4af33c233b\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") "
Sep 19 15:43:08.463147 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.463034    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b45e88a-5449-4400-a701-4b4af33c233b-istio-podinfo\") pod \"1b45e88a-5449-4400-a701-4b4af33c233b\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") "
Sep 19 15:43:08.463147 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.463077    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr9q8\" (UniqueName: \"kubernetes.io/projected/1b45e88a-5449-4400-a701-4b4af33c233b-kube-api-access-pr9q8\") pod \"1b45e88a-5449-4400-a701-4b4af33c233b\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") "
Sep 19 15:43:08.463147 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.463103    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-istio-data\") pod \"1b45e88a-5449-4400-a701-4b4af33c233b\" (UID: \"1b45e88a-5449-4400-a701-4b4af33c233b\") "
Sep 19 15:43:08.463447 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.463322    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b45e88a-5449-4400-a701-4b4af33c233b" (UID: "1b45e88a-5449-4400-a701-4b4af33c233b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:43:08.463447 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.463419    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b45e88a-5449-4400-a701-4b4af33c233b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b45e88a-5449-4400-a701-4b4af33c233b" (UID: "1b45e88a-5449-4400-a701-4b4af33c233b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:43:08.463537 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.463518    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b45e88a-5449-4400-a701-4b4af33c233b" (UID: "1b45e88a-5449-4400-a701-4b4af33c233b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:43:08.463588 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.463531    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b45e88a-5449-4400-a701-4b4af33c233b" (UID: "1b45e88a-5449-4400-a701-4b4af33c233b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:43:08.463732 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.463710    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b45e88a-5449-4400-a701-4b4af33c233b" (UID: "1b45e88a-5449-4400-a701-4b4af33c233b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:43:08.463828 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.463714    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:08.463960 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.463838    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:08.463960 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.463855    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b45e88a-5449-4400-a701-4b4af33c233b-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:08.463960 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.463866    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:08.465304 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.465277    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b45e88a-5449-4400-a701-4b4af33c233b-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b45e88a-5449-4400-a701-4b4af33c233b" (UID: "1b45e88a-5449-4400-a701-4b4af33c233b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:43:08.465304 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.465290    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b45e88a-5449-4400-a701-4b4af33c233b" (UID: "1b45e88a-5449-4400-a701-4b4af33c233b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:43:08.465438 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.465415    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b45e88a-5449-4400-a701-4b4af33c233b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b45e88a-5449-4400-a701-4b4af33c233b" (UID: "1b45e88a-5449-4400-a701-4b4af33c233b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:43:08.465915 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.465896    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b45e88a-5449-4400-a701-4b4af33c233b-kube-api-access-pr9q8" (OuterVolumeSpecName: "kube-api-access-pr9q8") pod "1b45e88a-5449-4400-a701-4b4af33c233b" (UID: "1b45e88a-5449-4400-a701-4b4af33c233b"). InnerVolumeSpecName "kube-api-access-pr9q8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:43:08.565167 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.565133    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b45e88a-5449-4400-a701-4b4af33c233b-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:08.565167 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.565163    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr9q8\" (UniqueName: \"kubernetes.io/projected/1b45e88a-5449-4400-a701-4b4af33c233b-kube-api-access-pr9q8\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:08.565370 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.565176    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b45e88a-5449-4400-a701-4b4af33c233b-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:08.565370 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.565190    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:08.565370 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.565229    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b45e88a-5449-4400-a701-4b4af33c233b-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:08.870402 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.870365    2562 generic.go:356] "Generic (PLEG): container finished" podID="1b45e88a-5449-4400-a701-4b4af33c233b" containerID="778f6ee72a3252870e32ae4f86434d26408ee3fe25a87a16feb7e0ce82919ad6" exitCode=0
Sep 19 15:43:08.870402 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.870406    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"
Sep 19 15:43:08.870629 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.870408    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r" event={"ID":"1b45e88a-5449-4400-a701-4b4af33c233b","Type":"ContainerDied","Data":"778f6ee72a3252870e32ae4f86434d26408ee3fe25a87a16feb7e0ce82919ad6"}
Sep 19 15:43:08.870629 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.870571    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r" event={"ID":"1b45e88a-5449-4400-a701-4b4af33c233b","Type":"ContainerDied","Data":"4d56f46876ac9d8405f9e77b5b190f0e123c6014f1390b75d387eaba147f13d2"}
Sep 19 15:43:08.870629 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.870601    2562 scope.go:117] "RemoveContainer" containerID="778f6ee72a3252870e32ae4f86434d26408ee3fe25a87a16feb7e0ce82919ad6"
Sep 19 15:43:08.881047 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.881031    2562 scope.go:117] "RemoveContainer" containerID="19c5362f7ff85cf6f3227786402d263fd2442db8f00e912a35e3057c6012971c"
Sep 19 15:43:08.889869 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.889852    2562 scope.go:117] "RemoveContainer" containerID="778f6ee72a3252870e32ae4f86434d26408ee3fe25a87a16feb7e0ce82919ad6"
Sep 19 15:43:08.890366 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:43:08.890344    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"778f6ee72a3252870e32ae4f86434d26408ee3fe25a87a16feb7e0ce82919ad6\": container with ID starting with 778f6ee72a3252870e32ae4f86434d26408ee3fe25a87a16feb7e0ce82919ad6 not found: ID does not exist" containerID="778f6ee72a3252870e32ae4f86434d26408ee3fe25a87a16feb7e0ce82919ad6"
Sep 19 15:43:08.890471 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.890373    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"778f6ee72a3252870e32ae4f86434d26408ee3fe25a87a16feb7e0ce82919ad6"} err="failed to get container status \"778f6ee72a3252870e32ae4f86434d26408ee3fe25a87a16feb7e0ce82919ad6\": rpc error: code = NotFound desc = could not find container \"778f6ee72a3252870e32ae4f86434d26408ee3fe25a87a16feb7e0ce82919ad6\": container with ID starting with 778f6ee72a3252870e32ae4f86434d26408ee3fe25a87a16feb7e0ce82919ad6 not found: ID does not exist"
Sep 19 15:43:08.890471 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.890419    2562 scope.go:117] "RemoveContainer" containerID="19c5362f7ff85cf6f3227786402d263fd2442db8f00e912a35e3057c6012971c"
Sep 19 15:43:08.890716 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:43:08.890698    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19c5362f7ff85cf6f3227786402d263fd2442db8f00e912a35e3057c6012971c\": container with ID starting with 19c5362f7ff85cf6f3227786402d263fd2442db8f00e912a35e3057c6012971c not found: ID does not exist" containerID="19c5362f7ff85cf6f3227786402d263fd2442db8f00e912a35e3057c6012971c"
Sep 19 15:43:08.890782 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.890722    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c5362f7ff85cf6f3227786402d263fd2442db8f00e912a35e3057c6012971c"} err="failed to get container status \"19c5362f7ff85cf6f3227786402d263fd2442db8f00e912a35e3057c6012971c\": rpc error: code = NotFound desc = could not find container \"19c5362f7ff85cf6f3227786402d263fd2442db8f00e912a35e3057c6012971c\": container with ID starting with 19c5362f7ff85cf6f3227786402d263fd2442db8f00e912a35e3057c6012971c not found: ID does not exist"
Sep 19 15:43:08.892822 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.892799    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"]
Sep 19 15:43:08.898017 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:08.897989    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r"]
Sep 19 15:43:09.345429 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:09.345402    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b45e88a-5449-4400-a701-4b4af33c233b" path="/var/lib/kubelet/pods/1b45e88a-5449-4400-a701-4b4af33c233b/volumes"
Sep 19 15:43:13.852956 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:13.852924    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:13.928024 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:13.927988    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:13.988731 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:13.988694    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:14.029907 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:14.029876    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw"]
Sep 19 15:43:14.032040 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:14.032014    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-c8e1cf-kbpbw"]
Sep 19 15:43:14.046555 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:14.046533    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:14.381400 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:14.381372    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:14.473697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:14.473668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:15.095265 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:15.095221    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:15.345395 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:15.345314    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="853acbee-b8ee-43a1-baf6-b0110953c137" path="/var/lib/kubelet/pods/853acbee-b8ee-43a1-baf6-b0110953c137/volumes"
Sep 19 15:43:15.966223 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:15.966166    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:16.483648 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:16.483620    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:18.444226 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:18.444175    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:43:20.213826 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.213789    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:20.318094 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.318060    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:20.459601 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.459567    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"]
Sep 19 15:43:20.459783 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.459763    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9" podUID="ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" containerName="istio-proxy" containerID="cri-o://81730fe2c13cbaf626879c9995908ad2c972bc5bb337c5c11a5261d9ea85d315" gracePeriod=30
Sep 19 15:43:20.488915 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.488800    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:20.836373 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.836340    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj"]
Sep 19 15:43:20.836759 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.836746    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b45e88a-5449-4400-a701-4b4af33c233b" containerName="istio-proxy"
Sep 19 15:43:20.836811 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.836760    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b45e88a-5449-4400-a701-4b4af33c233b" containerName="istio-proxy"
Sep 19 15:43:20.836811 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.836782    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c673305b-431c-4607-8802-4fbbc3370c46" containerName="istio-proxy"
Sep 19 15:43:20.836811 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.836787    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c673305b-431c-4607-8802-4fbbc3370c46" containerName="istio-proxy"
Sep 19 15:43:20.836811 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.836799    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="853acbee-b8ee-43a1-baf6-b0110953c137" containerName="revoke-keys"
Sep 19 15:43:20.836811 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.836806    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="853acbee-b8ee-43a1-baf6-b0110953c137" containerName="revoke-keys"
Sep 19 15:43:20.836964 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.836862    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c673305b-431c-4607-8802-4fbbc3370c46" containerName="istio-proxy"
Sep 19 15:43:20.836964 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.836873    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b45e88a-5449-4400-a701-4b4af33c233b" containerName="istio-proxy"
Sep 19 15:43:20.836964 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.836879    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b45e88a-5449-4400-a701-4b4af33c233b" containerName="istio-proxy"
Sep 19 15:43:20.836964 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.836885    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="853acbee-b8ee-43a1-baf6-b0110953c137" containerName="revoke-keys"
Sep 19 15:43:20.838866 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.838849    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj"
Sep 19 15:43:20.841309 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.841282    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 15:43:20.841445 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.841338    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7znsl\""
Sep 19 15:43:20.847778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.847754    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj"]
Sep 19 15:43:20.879797 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.879773    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39dca310-e43f-4c21-902c-186e93365b43-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj\" (UID: \"39dca310-e43f-4c21-902c-186e93365b43\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj"
Sep 19 15:43:20.981256 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.981224    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39dca310-e43f-4c21-902c-186e93365b43-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj\" (UID: \"39dca310-e43f-4c21-902c-186e93365b43\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj"
Sep 19 15:43:20.981832 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:20.981813    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39dca310-e43f-4c21-902c-186e93365b43-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj\" (UID: \"39dca310-e43f-4c21-902c-186e93365b43\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj"
Sep 19 15:43:21.095755 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:21.095675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:21.150287 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:21.150262    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj"
Sep 19 15:43:21.418473 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:21.418448    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj"]
Sep 19 15:43:21.420048 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:43:21.420022    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39dca310_e43f_4c21_902c_186e93365b43.slice/crio-fbefe834edd2fbad85e20ed86363d84d4a4915bb583a48a45cec704cce66c948 WatchSource:0}: Error finding container fbefe834edd2fbad85e20ed86363d84d4a4915bb583a48a45cec704cce66c948: Status 404 returned error can't find the container with id fbefe834edd2fbad85e20ed86363d84d4a4915bb583a48a45cec704cce66c948
Sep 19 15:43:21.613476 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:21.613446    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:21.946554 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:21.946447    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj" event={"ID":"39dca310-e43f-4c21-902c-186e93365b43","Type":"ContainerStarted","Data":"2c521fb546e4fdcfe6ebb92481b2a8399bcfd201df1c1b152a7864023f49d2d0"}
Sep 19 15:43:21.946554 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:21.946500    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj" event={"ID":"39dca310-e43f-4c21-902c-186e93365b43","Type":"ContainerStarted","Data":"fbefe834edd2fbad85e20ed86363d84d4a4915bb583a48a45cec704cce66c948"}
Sep 19 15:43:21.961608 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:21.961558    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj" podStartSLOduration=1.9615429089999998 podStartE2EDuration="1.961542909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:43:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:43:21.960408428 +0000 UTC m=+1865.123823479" watchObservedRunningTime="2026-09-19 15:43:21.961542909 +0000 UTC m=+1865.124957949"
Sep 19 15:43:22.359951 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:22.359918    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:22.867231 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:22.867181    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:22.953185 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:22.953150    2562 generic.go:356] "Generic (PLEG): container finished" podID="39dca310-e43f-4c21-902c-186e93365b43" containerID="2c521fb546e4fdcfe6ebb92481b2a8399bcfd201df1c1b152a7864023f49d2d0" exitCode=0
Sep 19 15:43:22.953370 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:22.953240    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj" event={"ID":"39dca310-e43f-4c21-902c-186e93365b43","Type":"ContainerDied","Data":"2c521fb546e4fdcfe6ebb92481b2a8399bcfd201df1c1b152a7864023f49d2d0"}
Sep 19 15:43:23.567003 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:23.566968    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:24.102144 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:24.102115    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj"
Sep 19 15:43:24.212860 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:24.212772    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39dca310-e43f-4c21-902c-186e93365b43-maas-api-service-ca\") pod \"39dca310-e43f-4c21-902c-186e93365b43\" (UID: \"39dca310-e43f-4c21-902c-186e93365b43\") "
Sep 19 15:43:24.213093 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:24.213071    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39dca310-e43f-4c21-902c-186e93365b43-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "39dca310-e43f-4c21-902c-186e93365b43" (UID: "39dca310-e43f-4c21-902c-186e93365b43"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:43:24.313548 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:24.313521    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39dca310-e43f-4c21-902c-186e93365b43-maas-api-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:24.966737 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:24.966709    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj"
Sep 19 15:43:24.966907 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:24.966753    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj" event={"ID":"39dca310-e43f-4c21-902c-186e93365b43","Type":"ContainerDied","Data":"fbefe834edd2fbad85e20ed86363d84d4a4915bb583a48a45cec704cce66c948"}
Sep 19 15:43:24.966907 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:24.966824    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbefe834edd2fbad85e20ed86363d84d4a4915bb583a48a45cec704cce66c948"
Sep 19 15:43:25.707114 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.707093    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:43:25.827331 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.827302    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-workload-certs\") pod \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") "
Sep 19 15:43:25.827543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.827368    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-credential-socket\") pod \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") "
Sep 19 15:43:25.827543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.827399    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-envoy\") pod \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") "
Sep 19 15:43:25.827543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.827439    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-workload-socket\") pod \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") "
Sep 19 15:43:25.827543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.827507    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-data\") pod \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") "
Sep 19 15:43:25.827760 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.827552    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-token\") pod \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") "
Sep 19 15:43:25.827760 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.827609    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-podinfo\") pod \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") "
Sep 19 15:43:25.827760 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.827639    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9cmc\" (UniqueName: \"kubernetes.io/projected/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-kube-api-access-c9cmc\") pod \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") "
Sep 19 15:43:25.827760 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.827547    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" (UID: "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:43:25.827760 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.827660    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" (UID: "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:43:25.827760 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.827667    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istiod-ca-cert\") pod \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\" (UID: \"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d\") "
Sep 19 15:43:25.827760 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.827738    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" (UID: "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:43:25.827760 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.827749    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" (UID: "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:43:25.828111 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.827982    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" (UID: "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:43:25.828111 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.828008    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:25.828111 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.828033    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:25.828111 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.828051    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:25.828111 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.828066    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:25.829745 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.829725    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" (UID: "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:43:25.829919 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.829899    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-kube-api-access-c9cmc" (OuterVolumeSpecName: "kube-api-access-c9cmc") pod "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" (UID: "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d"). InnerVolumeSpecName "kube-api-access-c9cmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:43:25.830277 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.830248    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" (UID: "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:43:25.830399 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.830254    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" (UID: "ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:43:25.929280 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.929238    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:25.929280 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.929269    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:25.929280 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.929283    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9cmc\" (UniqueName: \"kubernetes.io/projected/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-kube-api-access-c9cmc\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:25.929553 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.929295    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:25.929553 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.929307    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:25.973988 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.973960    2562 generic.go:356] "Generic (PLEG): container finished" podID="ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" containerID="81730fe2c13cbaf626879c9995908ad2c972bc5bb337c5c11a5261d9ea85d315" exitCode=0
Sep 19 15:43:25.974128 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.974008    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"
Sep 19 15:43:25.974128 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.974042    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9" event={"ID":"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d","Type":"ContainerDied","Data":"81730fe2c13cbaf626879c9995908ad2c972bc5bb337c5c11a5261d9ea85d315"}
Sep 19 15:43:25.974128 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.974097    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9" event={"ID":"ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d","Type":"ContainerDied","Data":"1ad1e28aaa92b3f61ae89635e7f02fc0334993913a651786a4d1efa3498ee9ae"}
Sep 19 15:43:25.974128 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.974122    2562 scope.go:117] "RemoveContainer" containerID="81730fe2c13cbaf626879c9995908ad2c972bc5bb337c5c11a5261d9ea85d315"
Sep 19 15:43:25.983634 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.983617    2562 scope.go:117] "RemoveContainer" containerID="d62c224fd08864dd2fc88f278ed950d06720a7341da803075d240eef7df0bb50"
Sep 19 15:43:25.997169 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.995479    2562 scope.go:117] "RemoveContainer" containerID="81730fe2c13cbaf626879c9995908ad2c972bc5bb337c5c11a5261d9ea85d315"
Sep 19 15:43:25.998252 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:43:25.998103    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81730fe2c13cbaf626879c9995908ad2c972bc5bb337c5c11a5261d9ea85d315\": container with ID starting with 81730fe2c13cbaf626879c9995908ad2c972bc5bb337c5c11a5261d9ea85d315 not found: ID does not exist" containerID="81730fe2c13cbaf626879c9995908ad2c972bc5bb337c5c11a5261d9ea85d315"
Sep 19 15:43:25.998252 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.998139    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81730fe2c13cbaf626879c9995908ad2c972bc5bb337c5c11a5261d9ea85d315"} err="failed to get container status \"81730fe2c13cbaf626879c9995908ad2c972bc5bb337c5c11a5261d9ea85d315\": rpc error: code = NotFound desc = could not find container \"81730fe2c13cbaf626879c9995908ad2c972bc5bb337c5c11a5261d9ea85d315\": container with ID starting with 81730fe2c13cbaf626879c9995908ad2c972bc5bb337c5c11a5261d9ea85d315 not found: ID does not exist"
Sep 19 15:43:25.998252 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.998163    2562 scope.go:117] "RemoveContainer" containerID="d62c224fd08864dd2fc88f278ed950d06720a7341da803075d240eef7df0bb50"
Sep 19 15:43:25.998602 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:43:25.998548    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d62c224fd08864dd2fc88f278ed950d06720a7341da803075d240eef7df0bb50\": container with ID starting with d62c224fd08864dd2fc88f278ed950d06720a7341da803075d240eef7df0bb50 not found: ID does not exist" containerID="d62c224fd08864dd2fc88f278ed950d06720a7341da803075d240eef7df0bb50"
Sep 19 15:43:25.998602 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.998580    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d62c224fd08864dd2fc88f278ed950d06720a7341da803075d240eef7df0bb50"} err="failed to get container status \"d62c224fd08864dd2fc88f278ed950d06720a7341da803075d240eef7df0bb50\": rpc error: code = NotFound desc = could not find container \"d62c224fd08864dd2fc88f278ed950d06720a7341da803075d240eef7df0bb50\": container with ID starting with d62c224fd08864dd2fc88f278ed950d06720a7341da803075d240eef7df0bb50 not found: ID does not exist"
Sep 19 15:43:25.999310 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:25.999295    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"]
Sep 19 15:43:26.001481 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:26.001464    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9"]
Sep 19 15:43:27.346083 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:27.346050    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" path="/var/lib/kubelet/pods/ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d/volumes"
Sep 19 15:43:31.264559 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:31.264530    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:31.331153 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:31.331118    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:31.386216 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:31.386165    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:31.438776 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:31.438750    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj"]
Sep 19 15:43:31.440890 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:31.440867    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-da587f-gr8zj"]
Sep 19 15:43:31.447548 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:31.447527    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:31.781715 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:31.781668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:31.881921 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:31.881884    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:32.661104 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:32.661065    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:33.281601 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:33.281568    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:33.345916 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:33.345883    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39dca310-e43f-4c21-902c-186e93365b43" path="/var/lib/kubelet/pods/39dca310-e43f-4c21-902c-186e93365b43/volumes"
Sep 19 15:43:35.134410 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:35.134375    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:43:37.400961 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:37.400928    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:37.550026 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:37.549991    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:37.654638 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:37.654558    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"]
Sep 19 15:43:37.654821 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:37.654789    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf" podUID="5ee5c886-e1ba-47c2-8b38-7cce30711a5b" containerName="istio-proxy" containerID="cri-o://5265ad4223bdae09bc71d8f0fa06c4ba79bedad3744efa7aa1a027cf6e669f3a" gracePeriod=30
Sep 19 15:43:37.670612 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:37.670568    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:42.745467 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:42.745440    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 19 15:43:42.745748 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:42.745489    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf" podUID="5ee5c886-e1ba-47c2-8b38-7cce30711a5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 19 15:43:42.911308 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:42.911279    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:43:43.069326 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.069297    2562 generic.go:356] "Generic (PLEG): container finished" podID="5ee5c886-e1ba-47c2-8b38-7cce30711a5b" containerID="5265ad4223bdae09bc71d8f0fa06c4ba79bedad3744efa7aa1a027cf6e669f3a" exitCode=0
Sep 19 15:43:43.069489 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.069363    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"
Sep 19 15:43:43.069489 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.069371    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf" event={"ID":"5ee5c886-e1ba-47c2-8b38-7cce30711a5b","Type":"ContainerDied","Data":"5265ad4223bdae09bc71d8f0fa06c4ba79bedad3744efa7aa1a027cf6e669f3a"}
Sep 19 15:43:43.069583 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.069501    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf" event={"ID":"5ee5c886-e1ba-47c2-8b38-7cce30711a5b","Type":"ContainerDied","Data":"9ee7af43d617d2f9ecbec056c4534d52da1bbecac0c2e034b70dced378df804b"}
Sep 19 15:43:43.069583 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.069536    2562 scope.go:117] "RemoveContainer" containerID="5265ad4223bdae09bc71d8f0fa06c4ba79bedad3744efa7aa1a027cf6e669f3a"
Sep 19 15:43:43.078451 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.078432    2562 scope.go:117] "RemoveContainer" containerID="41a60baf897b30a3c1680977303e85c586c176b6142072bf9b95163a51e284ad"
Sep 19 15:43:43.086395 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.086380    2562 scope.go:117] "RemoveContainer" containerID="5265ad4223bdae09bc71d8f0fa06c4ba79bedad3744efa7aa1a027cf6e669f3a"
Sep 19 15:43:43.086637 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:43:43.086619    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5265ad4223bdae09bc71d8f0fa06c4ba79bedad3744efa7aa1a027cf6e669f3a\": container with ID starting with 5265ad4223bdae09bc71d8f0fa06c4ba79bedad3744efa7aa1a027cf6e669f3a not found: ID does not exist" containerID="5265ad4223bdae09bc71d8f0fa06c4ba79bedad3744efa7aa1a027cf6e669f3a"
Sep 19 15:43:43.086686 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.086645    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5265ad4223bdae09bc71d8f0fa06c4ba79bedad3744efa7aa1a027cf6e669f3a"} err="failed to get container status \"5265ad4223bdae09bc71d8f0fa06c4ba79bedad3744efa7aa1a027cf6e669f3a\": rpc error: code = NotFound desc = could not find container \"5265ad4223bdae09bc71d8f0fa06c4ba79bedad3744efa7aa1a027cf6e669f3a\": container with ID starting with 5265ad4223bdae09bc71d8f0fa06c4ba79bedad3744efa7aa1a027cf6e669f3a not found: ID does not exist"
Sep 19 15:43:43.086686 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.086661    2562 scope.go:117] "RemoveContainer" containerID="41a60baf897b30a3c1680977303e85c586c176b6142072bf9b95163a51e284ad"
Sep 19 15:43:43.086911 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:43:43.086895    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41a60baf897b30a3c1680977303e85c586c176b6142072bf9b95163a51e284ad\": container with ID starting with 41a60baf897b30a3c1680977303e85c586c176b6142072bf9b95163a51e284ad not found: ID does not exist" containerID="41a60baf897b30a3c1680977303e85c586c176b6142072bf9b95163a51e284ad"
Sep 19 15:43:43.086959 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.086915    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a60baf897b30a3c1680977303e85c586c176b6142072bf9b95163a51e284ad"} err="failed to get container status \"41a60baf897b30a3c1680977303e85c586c176b6142072bf9b95163a51e284ad\": rpc error: code = NotFound desc = could not find container \"41a60baf897b30a3c1680977303e85c586c176b6142072bf9b95163a51e284ad\": container with ID starting with 41a60baf897b30a3c1680977303e85c586c176b6142072bf9b95163a51e284ad not found: ID does not exist"
Sep 19 15:43:43.091827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.091807    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-workload-certs\") pod \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") "
Sep 19 15:43:43.091927 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.091858    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-token\") pod \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") "
Sep 19 15:43:43.091927 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.091889    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-workload-socket\") pod \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") "
Sep 19 15:43:43.092045 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.091959    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-credential-socket\") pod \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") "
Sep 19 15:43:43.092045 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.091984    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-envoy\") pod \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") "
Sep 19 15:43:43.092045 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.092015    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-podinfo\") pod \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") "
Sep 19 15:43:43.092230 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.092074    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-data\") pod \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") "
Sep 19 15:43:43.092230 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.092090    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5ee5c886-e1ba-47c2-8b38-7cce30711a5b" (UID: "5ee5c886-e1ba-47c2-8b38-7cce30711a5b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:43:43.092230 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.092100    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istiod-ca-cert\") pod \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") "
Sep 19 15:43:43.092393 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.092226    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5ee5c886-e1ba-47c2-8b38-7cce30711a5b" (UID: "5ee5c886-e1ba-47c2-8b38-7cce30711a5b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:43:43.092393 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.092242    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9k2h\" (UniqueName: \"kubernetes.io/projected/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-kube-api-access-p9k2h\") pod \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\" (UID: \"5ee5c886-e1ba-47c2-8b38-7cce30711a5b\") "
Sep 19 15:43:43.092501 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.092451    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5ee5c886-e1ba-47c2-8b38-7cce30711a5b" (UID: "5ee5c886-e1ba-47c2-8b38-7cce30711a5b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:43:43.092747 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.092552    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-data" (OuterVolumeSpecName: "istio-data") pod "5ee5c886-e1ba-47c2-8b38-7cce30711a5b" (UID: "5ee5c886-e1ba-47c2-8b38-7cce30711a5b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:43:43.092747 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.092672    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:43.092747 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.092690    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:43.092747 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.092714    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:43.092747 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.092716    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5ee5c886-e1ba-47c2-8b38-7cce30711a5b" (UID: "5ee5c886-e1ba-47c2-8b38-7cce30711a5b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:43:43.092747 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.092727    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:43.094559 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.094534    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5ee5c886-e1ba-47c2-8b38-7cce30711a5b" (UID: "5ee5c886-e1ba-47c2-8b38-7cce30711a5b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:43:43.094626 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.094564    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5ee5c886-e1ba-47c2-8b38-7cce30711a5b" (UID: "5ee5c886-e1ba-47c2-8b38-7cce30711a5b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:43:43.094807 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.094791    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-kube-api-access-p9k2h" (OuterVolumeSpecName: "kube-api-access-p9k2h") pod "5ee5c886-e1ba-47c2-8b38-7cce30711a5b" (UID: "5ee5c886-e1ba-47c2-8b38-7cce30711a5b"). InnerVolumeSpecName "kube-api-access-p9k2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:43:43.094956 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.094942    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-token" (OuterVolumeSpecName: "istio-token") pod "5ee5c886-e1ba-47c2-8b38-7cce30711a5b" (UID: "5ee5c886-e1ba-47c2-8b38-7cce30711a5b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:43:43.193977 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.193943    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:43.193977 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.193969    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:43.193977 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.193982    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:43.194191 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.193995    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9k2h\" (UniqueName: \"kubernetes.io/projected/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-kube-api-access-p9k2h\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:43.194191 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.194006    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ee5c886-e1ba-47c2-8b38-7cce30711a5b-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:43:43.384072 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.384043    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"]
Sep 19 15:43:43.388814 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:43.388786    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf"]
Sep 19 15:43:45.344007 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:45.343977    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ee5c886-e1ba-47c2-8b38-7cce30711a5b" path="/var/lib/kubelet/pods/5ee5c886-e1ba-47c2-8b38-7cce30711a5b/volumes"
Sep 19 15:43:49.947562 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:49.947514    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:43:54.121275 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:54.121238    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"]
Sep 19 15:43:54.139877 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:54.139848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:55.032074 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.032039    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:55.461156 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.461121    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:55.732785 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.732693    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"]
Sep 19 15:43:55.733209 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.733178    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" containerName="istio-proxy"
Sep 19 15:43:55.733310 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.733214    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" containerName="istio-proxy"
Sep 19 15:43:55.733310 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.733233    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39dca310-e43f-4c21-902c-186e93365b43" containerName="revoke-keys"
Sep 19 15:43:55.733310 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.733241    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="39dca310-e43f-4c21-902c-186e93365b43" containerName="revoke-keys"
Sep 19 15:43:55.733310 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.733252    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee5c886-e1ba-47c2-8b38-7cce30711a5b" containerName="istio-proxy"
Sep 19 15:43:55.733310 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.733260    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee5c886-e1ba-47c2-8b38-7cce30711a5b" containerName="istio-proxy"
Sep 19 15:43:55.733310 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.733280    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b45e88a-5449-4400-a701-4b4af33c233b" containerName="istio-proxy"
Sep 19 15:43:55.733310 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.733288    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b45e88a-5449-4400-a701-4b4af33c233b" containerName="istio-proxy"
Sep 19 15:43:55.733644 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.733404    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ee5c886-e1ba-47c2-8b38-7cce30711a5b" containerName="istio-proxy"
Sep 19 15:43:55.733644 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.733414    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="39dca310-e43f-4c21-902c-186e93365b43" containerName="revoke-keys"
Sep 19 15:43:55.733644 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.733426    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" containerName="istio-proxy"
Sep 19 15:43:55.733644 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.733436    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ee5c886-e1ba-47c2-8b38-7cce30711a5b" containerName="istio-proxy"
Sep 19 15:43:55.733644 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.733446    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" containerName="istio-proxy"
Sep 19 15:43:55.736704 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.736675    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.739049 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.739029    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-521326-openshift-default-dockercfg-nmq6k\""
Sep 19 15:43:55.748739 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.748716    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"]
Sep 19 15:43:55.758576 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.758552    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:55.803782 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.803753    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f073bd53-5037-4bb9-a557-36fbadd19659-istio-token\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.803955 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.803788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f073bd53-5037-4bb9-a557-36fbadd19659-istiod-ca-cert\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.803955 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.803857    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-istio-envoy\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.803955 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.803899    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-workload-socket\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.803955 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.803951    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6q68\" (UniqueName: \"kubernetes.io/projected/f073bd53-5037-4bb9-a557-36fbadd19659-kube-api-access-f6q68\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.804099 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.804039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-credential-socket\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.804099 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.804091    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f073bd53-5037-4bb9-a557-36fbadd19659-istio-podinfo\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.804163 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.804141    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-workload-certs\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.804213 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.804171    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-istio-data\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.904864 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.904817    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-credential-socket\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.905045 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.904898    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f073bd53-5037-4bb9-a557-36fbadd19659-istio-podinfo\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.905045 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.904961    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-workload-certs\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.905045 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.904989    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-istio-data\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.905045 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.905027    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f073bd53-5037-4bb9-a557-36fbadd19659-istio-token\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.905301 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.905060    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f073bd53-5037-4bb9-a557-36fbadd19659-istiod-ca-cert\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.905301 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.905117    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-istio-envoy\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.905301 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.905146    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-workload-socket\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.905301 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.905226    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6q68\" (UniqueName: \"kubernetes.io/projected/f073bd53-5037-4bb9-a557-36fbadd19659-kube-api-access-f6q68\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.905534 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.905311    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-credential-socket\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.905534 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.905344    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-workload-certs\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.905534 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.905420    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-istio-data\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.905696 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.905680    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-workload-socket\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.905919 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.905867    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f073bd53-5037-4bb9-a557-36fbadd19659-istiod-ca-cert\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.907545 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.907519    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-istio-envoy\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.907665 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.907645    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f073bd53-5037-4bb9-a557-36fbadd19659-istio-podinfo\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.912605 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.912584    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f073bd53-5037-4bb9-a557-36fbadd19659-istio-token\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:55.912734 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:55.912610    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6q68\" (UniqueName: \"kubernetes.io/projected/f073bd53-5037-4bb9-a557-36fbadd19659-kube-api-access-f6q68\") pod \"e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") " pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:56.048599 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:56.048569    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:56.325039 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:56.325009    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"]
Sep 19 15:43:56.326993 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:43:56.326965    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf073bd53_5037_4bb9_a557_36fbadd19659.slice/crio-e57e3b0ab09feacec959b660ff44243669d6bf0a71bbb9e4dec65cab4388994e WatchSource:0}: Error finding container e57e3b0ab09feacec959b660ff44243669d6bf0a71bbb9e4dec65cab4388994e: Status 404 returned error can't find the container with id e57e3b0ab09feacec959b660ff44243669d6bf0a71bbb9e4dec65cab4388994e
Sep 19 15:43:56.329741 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:56.329709    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:43:56.329815 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:56.329783    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:43:56.329815 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:56.329811    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:43:56.343014 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:56.342992    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:57.147391 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:57.147347    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c" event={"ID":"f073bd53-5037-4bb9-a557-36fbadd19659","Type":"ContainerStarted","Data":"7c02e1c3d25d799c1a0a8303e2f8e13dcee86fb9d771708990ce57cc309b9cab"}
Sep 19 15:43:57.147391 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:57.147398    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c" event={"ID":"f073bd53-5037-4bb9-a557-36fbadd19659","Type":"ContainerStarted","Data":"e57e3b0ab09feacec959b660ff44243669d6bf0a71bbb9e4dec65cab4388994e"}
Sep 19 15:43:57.168655 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:57.168611    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c" podStartSLOduration=2.168594636 podStartE2EDuration="2.168594636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:43:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:43:57.166550664 +0000 UTC m=+1900.329965725" watchObservedRunningTime="2026-09-19 15:43:57.168594636 +0000 UTC m=+1900.332009675"
Sep 19 15:43:58.049128 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:58.049089    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:58.053881 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:58.053855    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:58.153258 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:58.153228    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:58.154297 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:58.154278    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:43:58.373415 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:58.373330    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:59.039179 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:59.039145    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:59.136967 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:59.136917    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:59.235881 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:59.235838    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:43:59.542379 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:59.542336    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:43:59.921679 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:43:59.921586    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:00.472275 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:00.472236    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:00.573411 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:00.573378    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:00.672678 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:00.672649    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:00.948775 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:00.948729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:01.039580 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:01.039550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:09.141371 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.141320    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd" podUID="eb907f49-56d3-4b68-966b-887954899625" containerName="main" containerID="cri-o://e061aa2d0a9c2f3cc5925bcc94535ea456f846538954d313c310538d41770de5" gracePeriod=45
Sep 19 15:44:09.443333 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.443309    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:44:09.540478 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.540444    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-home\") pod \"eb907f49-56d3-4b68-966b-887954899625\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") "
Sep 19 15:44:09.540478 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.540480    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-model-cache\") pod \"eb907f49-56d3-4b68-966b-887954899625\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") "
Sep 19 15:44:09.540733 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.540520    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-dshm\") pod \"eb907f49-56d3-4b68-966b-887954899625\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") "
Sep 19 15:44:09.540733 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.540561    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-tmp-dir\") pod \"eb907f49-56d3-4b68-966b-887954899625\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") "
Sep 19 15:44:09.540733 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.540602    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk8r7\" (UniqueName: \"kubernetes.io/projected/eb907f49-56d3-4b68-966b-887954899625-kube-api-access-kk8r7\") pod \"eb907f49-56d3-4b68-966b-887954899625\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") "
Sep 19 15:44:09.540733 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.540728    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb907f49-56d3-4b68-966b-887954899625-tls-certs\") pod \"eb907f49-56d3-4b68-966b-887954899625\" (UID: \"eb907f49-56d3-4b68-966b-887954899625\") "
Sep 19 15:44:09.540733 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.540728    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-home" (OuterVolumeSpecName: "home") pod "eb907f49-56d3-4b68-966b-887954899625" (UID: "eb907f49-56d3-4b68-966b-887954899625"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:44:09.540981 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.540742    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-model-cache" (OuterVolumeSpecName: "model-cache") pod "eb907f49-56d3-4b68-966b-887954899625" (UID: "eb907f49-56d3-4b68-966b-887954899625"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:44:09.540981 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.540800    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eb907f49-56d3-4b68-966b-887954899625" (UID: "eb907f49-56d3-4b68-966b-887954899625"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:44:09.541054 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.541001    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-home\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:44:09.541054 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.541017    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-model-cache\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:44:09.541054 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.541027    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-tmp-dir\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:44:09.542907 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.542883    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb907f49-56d3-4b68-966b-887954899625-kube-api-access-kk8r7" (OuterVolumeSpecName: "kube-api-access-kk8r7") pod "eb907f49-56d3-4b68-966b-887954899625" (UID: "eb907f49-56d3-4b68-966b-887954899625"). InnerVolumeSpecName "kube-api-access-kk8r7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:44:09.543000 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.542882    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb907f49-56d3-4b68-966b-887954899625-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eb907f49-56d3-4b68-966b-887954899625" (UID: "eb907f49-56d3-4b68-966b-887954899625"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:44:09.543000 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.542941    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-dshm" (OuterVolumeSpecName: "dshm") pod "eb907f49-56d3-4b68-966b-887954899625" (UID: "eb907f49-56d3-4b68-966b-887954899625"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:44:09.641575 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.641542    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb907f49-56d3-4b68-966b-887954899625-dshm\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:44:09.641575 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.641570    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk8r7\" (UniqueName: \"kubernetes.io/projected/eb907f49-56d3-4b68-966b-887954899625-kube-api-access-kk8r7\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:44:09.641575 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:09.641580    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb907f49-56d3-4b68-966b-887954899625-tls-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:44:10.249919 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:10.249821    2562 generic.go:356] "Generic (PLEG): container finished" podID="eb907f49-56d3-4b68-966b-887954899625" containerID="e061aa2d0a9c2f3cc5925bcc94535ea456f846538954d313c310538d41770de5" exitCode=0
Sep 19 15:44:10.249919 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:10.249867    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"
Sep 19 15:44:10.249919 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:10.249905    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd" event={"ID":"eb907f49-56d3-4b68-966b-887954899625","Type":"ContainerDied","Data":"e061aa2d0a9c2f3cc5925bcc94535ea456f846538954d313c310538d41770de5"}
Sep 19 15:44:10.250525 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:10.249949    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd" event={"ID":"eb907f49-56d3-4b68-966b-887954899625","Type":"ContainerDied","Data":"8d50a6f4b0bc3b785fb268f2f5fff16e8bcf19b52ef285857d3df17cbdb0e611"}
Sep 19 15:44:10.250525 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:10.249966    2562 scope.go:117] "RemoveContainer" containerID="e061aa2d0a9c2f3cc5925bcc94535ea456f846538954d313c310538d41770de5"
Sep 19 15:44:10.259519 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:10.259503    2562 scope.go:117] "RemoveContainer" containerID="e061aa2d0a9c2f3cc5925bcc94535ea456f846538954d313c310538d41770de5"
Sep 19 15:44:10.259782 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:44:10.259765    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e061aa2d0a9c2f3cc5925bcc94535ea456f846538954d313c310538d41770de5\": container with ID starting with e061aa2d0a9c2f3cc5925bcc94535ea456f846538954d313c310538d41770de5 not found: ID does not exist" containerID="e061aa2d0a9c2f3cc5925bcc94535ea456f846538954d313c310538d41770de5"
Sep 19 15:44:10.259846 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:10.259791    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e061aa2d0a9c2f3cc5925bcc94535ea456f846538954d313c310538d41770de5"} err="failed to get container status \"e061aa2d0a9c2f3cc5925bcc94535ea456f846538954d313c310538d41770de5\": rpc error: code = NotFound desc = could not find container \"e061aa2d0a9c2f3cc5925bcc94535ea456f846538954d313c310538d41770de5\": container with ID starting with e061aa2d0a9c2f3cc5925bcc94535ea456f846538954d313c310538d41770de5 not found: ID does not exist"
Sep 19 15:44:10.270222 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:10.270171    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"]
Sep 19 15:44:10.273423 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:10.273396    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w2-50372a/rate-test-model-50372a-kserve-b8565fc47-z8vfd"]
Sep 19 15:44:11.344718 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:11.344679    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb907f49-56d3-4b68-966b-887954899625" path="/var/lib/kubelet/pods/eb907f49-56d3-4b68-966b-887954899625/volumes"
Sep 19 15:44:11.738564 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:11.738533    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:44:14.195361 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:14.195310    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 19 15:44:14.195847 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:14.195371    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c" podUID="f073bd53-5037-4bb9-a557-36fbadd19659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 19 15:44:15.280501 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:15.280470    2562 generic.go:356] "Generic (PLEG): container finished" podID="f073bd53-5037-4bb9-a557-36fbadd19659" containerID="7c02e1c3d25d799c1a0a8303e2f8e13dcee86fb9d771708990ce57cc309b9cab" exitCode=0
Sep 19 15:44:15.280930 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:15.280553    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c" event={"ID":"f073bd53-5037-4bb9-a557-36fbadd19659","Type":"ContainerDied","Data":"7c02e1c3d25d799c1a0a8303e2f8e13dcee86fb9d771708990ce57cc309b9cab"}
Sep 19 15:44:15.280983 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:15.280945    2562 scope.go:117] "RemoveContainer" containerID="7c02e1c3d25d799c1a0a8303e2f8e13dcee86fb9d771708990ce57cc309b9cab"
Sep 19 15:44:15.282079 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:15.282051    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:44:15.282154 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:15.282128    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:44:15.282190 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:15.282163    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:44:16.287699 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:16.287661    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c" event={"ID":"f073bd53-5037-4bb9-a557-36fbadd19659","Type":"ContainerStarted","Data":"f4aea0027f3cf3ee508b7a28f51ad0ed076278cd7d6095185e81dab5fcf6db91"}
Sep 19 15:44:17.049332 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:17.049295    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:44:17.049524 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:17.049502    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 19 15:44:17.049570 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:17.049548    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c" podUID="f073bd53-5037-4bb9-a557-36fbadd19659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 19 15:44:17.865891 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:17.865858    2562 scope.go:117] "RemoveContainer" containerID="1d980965aea9ecf521c3cc8605b819ff22d5f65613e6c12f5d05988e339fbb54"
Sep 19 15:44:18.049150 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:18.049106    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 19 15:44:18.049338 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:18.049168    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c" podUID="f073bd53-5037-4bb9-a557-36fbadd19659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 19 15:44:19.049585 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:19.049554    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 19 15:44:19.050012 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:19.049609    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c" podUID="f073bd53-5037-4bb9-a557-36fbadd19659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 19 15:44:20.049009 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:20.048973    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 19 15:44:20.049185 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:20.049027    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c" podUID="f073bd53-5037-4bb9-a557-36fbadd19659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 19 15:44:21.049812 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:21.049775    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 19 15:44:21.050177 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:21.049833    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c" podUID="f073bd53-5037-4bb9-a557-36fbadd19659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 19 15:44:22.052526 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:22.052497    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:44:22.052901 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:22.052861    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:44:22.053562 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:22.053543    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:44:23.569241 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:23.569180    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:23.995166 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:23.995091    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:24.095337 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:24.095303    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:24.658219 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:24.658172    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:24.868668 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:24.868640    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:24.941492 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:24.941398    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"]
Sep 19 15:44:24.941817 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:24.941804    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" containerName="istio-proxy"
Sep 19 15:44:24.941889 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:24.941818    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec8fa88e-ee5d-40ed-b0f7-f678c3a9df7d" containerName="istio-proxy"
Sep 19 15:44:24.941889 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:24.941827    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb907f49-56d3-4b68-966b-887954899625" containerName="main"
Sep 19 15:44:24.941889 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:24.941831    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb907f49-56d3-4b68-966b-887954899625" containerName="main"
Sep 19 15:44:24.941889 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:24.941840    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee5c886-e1ba-47c2-8b38-7cce30711a5b" containerName="istio-proxy"
Sep 19 15:44:24.941889 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:24.941846    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee5c886-e1ba-47c2-8b38-7cce30711a5b" containerName="istio-proxy"
Sep 19 15:44:24.942054 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:24.941903    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb907f49-56d3-4b68-966b-887954899625" containerName="main"
Sep 19 15:44:24.943949 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:24.943930    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:24.946569 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:24.946519    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-30ef69-openshift-default-dockercfg-hjrxs\""
Sep 19 15:44:24.956941 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:24.956918    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"]
Sep 19 15:44:24.968430 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:24.968409    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:25.095622 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.095583    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-workload-certs\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.095805 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.095634    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-data\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.095805 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.095741    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwcv5\" (UniqueName: \"kubernetes.io/projected/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-kube-api-access-bwcv5\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.095805 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.095775    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-podinfo\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.095963 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.095820    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-workload-socket\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.095963 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.095850    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-envoy\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.095963 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.095882    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-token\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.095963 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.095912    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-credential-socket\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.095963 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.095946    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istiod-ca-cert\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.196987 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.196886    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwcv5\" (UniqueName: \"kubernetes.io/projected/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-kube-api-access-bwcv5\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.196987 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.196930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-podinfo\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.197246 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.196988    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-workload-socket\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.197246 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.197030    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-envoy\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.197246 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.197075    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-token\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.197246 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.197107    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-credential-socket\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.197246 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.197132    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istiod-ca-cert\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.197246 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.197190    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-workload-certs\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.197561 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.197266    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-data\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.197561 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.197505    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-workload-socket\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.197671 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.197613    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-credential-socket\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.197759 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.197742    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-workload-certs\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.197831 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.197801    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-data\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.198405 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.198378    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istiod-ca-cert\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.199649 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.199631    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-envoy\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.199932 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.199915    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-podinfo\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.204340 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.204319    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-token\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.204704 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.204686    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwcv5\" (UniqueName: \"kubernetes.io/projected/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-kube-api-access-bwcv5\") pod \"e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") " pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.254893 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.254867    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:25.457612 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.457538    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:25.527252 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.527229    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"]
Sep 19 15:44:25.528653 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:44:25.528631    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec30ae4b_b1a7_41cf_87d4_f4b4a418bab1.slice/crio-d967ad91d3462ea075f3b9a4f2185e803432ee102adb8677a7347d76b552db07 WatchSource:0}: Error finding container d967ad91d3462ea075f3b9a4f2185e803432ee102adb8677a7347d76b552db07: Status 404 returned error can't find the container with id d967ad91d3462ea075f3b9a4f2185e803432ee102adb8677a7347d76b552db07
Sep 19 15:44:25.531103 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.531069    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:44:25.531171 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.531138    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:44:25.531237 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.531171    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:44:25.557637 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:25.557612    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:26.357179 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:26.357141    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4" event={"ID":"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1","Type":"ContainerStarted","Data":"6772d4686551271fd16df5af725462a64c560c07240c01ce556dcfff403aca4e"}
Sep 19 15:44:26.357557 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:26.357189    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4" event={"ID":"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1","Type":"ContainerStarted","Data":"d967ad91d3462ea075f3b9a4f2185e803432ee102adb8677a7347d76b552db07"}
Sep 19 15:44:26.376845 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:26.376798    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4" podStartSLOduration=2.3767836940000002 podStartE2EDuration="2.376783694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:44:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:44:26.373937639 +0000 UTC m=+1929.537352680" watchObservedRunningTime="2026-09-19 15:44:26.376783694 +0000 UTC m=+1929.540198733"
Sep 19 15:44:27.256082 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:27.256045    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:27.260900 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:27.260865    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:27.362515 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:27.362488    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:27.363390 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:27.363373    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:27.582150 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:27.582122    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:28.254415 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:28.254386    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:28.362350 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:28.362319    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:28.456249 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:28.456185    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:29.056877 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:29.056832    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:29.882633 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:29.882577    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:30.582472 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:30.582442    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:30.683472 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:30.683441    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:31.052643 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:31.052599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:31.159047 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:31.159013    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:31.244816 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:31.244783    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:35.052842 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:35.052807    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:44:43.404363 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:43.404312    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 19 15:44:43.404789 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:43.404391    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4" podUID="ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 19 15:44:45.462123 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:45.462091    2562 generic.go:356] "Generic (PLEG): container finished" podID="ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" containerID="6772d4686551271fd16df5af725462a64c560c07240c01ce556dcfff403aca4e" exitCode=0
Sep 19 15:44:45.462536 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:45.462163    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4" event={"ID":"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1","Type":"ContainerDied","Data":"6772d4686551271fd16df5af725462a64c560c07240c01ce556dcfff403aca4e"}
Sep 19 15:44:45.462536 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:45.462531    2562 scope.go:117] "RemoveContainer" containerID="6772d4686551271fd16df5af725462a64c560c07240c01ce556dcfff403aca4e"
Sep 19 15:44:45.463608 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:45.463580    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:44:45.463673 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:45.463657    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:44:45.463711 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:45.463693    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:44:46.470397 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:46.470358    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4" event={"ID":"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1","Type":"ContainerStarted","Data":"7e894ed8935680ed9ea73c53d7e3f4965876c0026181c5654bc22537a211ed4e"}
Sep 19 15:44:47.255111 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:47.255076    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:47.255318 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:47.255260    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 19 15:44:47.255318 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:47.255307    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4" podUID="ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 19 15:44:48.255576 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:48.255541    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 19 15:44:48.255951 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:48.255598    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4" podUID="ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 19 15:44:48.783601 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:48.783567    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:49.255690 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:49.255601    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 19 15:44:49.256056 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:49.255655    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4" podUID="ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 19 15:44:50.255503 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:50.255470    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 19 15:44:50.255697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:50.255525    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4" podUID="ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 19 15:44:51.255751 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:51.255716    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 19 15:44:51.256267 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:51.255776    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4" podUID="ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 19 15:44:52.049154 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:52.049118    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:52.258879 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:52.258851    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:52.259246 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:52.259135    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:52.259794 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:52.259777    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:44:53.238138 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:53.238107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:53.335004 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:53.334973    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:53.965507 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:53.965477    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:54.575299 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:54.575265    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:55.095460 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:55.095429    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:44:55.872509 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:44:55.872478    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:45:00.128843 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.128807    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-30ef69-29830545-xdn5p"]
Sep 19 15:45:00.131386 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.131362    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-30ef69-29830545-xdn5p"
Sep 19 15:45:00.131505 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.131452    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29830545-krcdm"]
Sep 19 15:45:00.133801 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.133782    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7znsl\""
Sep 19 15:45:00.134974 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.134955    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830545-krcdm"
Sep 19 15:45:00.135090 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.135068    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-521326-29830545-cgzxc"]
Sep 19 15:45:00.137307 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.137285    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-521326-29830545-cgzxc"
Sep 19 15:45:00.137454 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.137394    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9c5c2-29830545-8ct8q"]
Sep 19 15:45:00.139969 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.139952    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9c5c2-29830545-8ct8q"
Sep 19 15:45:00.140241 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.140078    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-30ef69-29830545-xdn5p"]
Sep 19 15:45:00.142778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.142756    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29830545-krcdm"]
Sep 19 15:45:00.146863 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.146843    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-30ef69-29830545-xdn5p"
Sep 19 15:45:00.148172 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.147952    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9c5c2-29830545-8ct8q"]
Sep 19 15:45:00.152064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.152044    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-521326-29830545-cgzxc"]
Sep 19 15:45:00.157630 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.157614    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830545-krcdm"
Sep 19 15:45:00.188354 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.188331    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-521326-29830545-cgzxc"
Sep 19 15:45:00.196177 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.196052    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9c5c2-29830545-8ct8q"
Sep 19 15:45:00.439540 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.439505    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-30ef69-29830545-xdn5p"]
Sep 19 15:45:00.441599 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.441571    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29830545-krcdm"]
Sep 19 15:45:00.442125 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:45:00.442102    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6baf3e1_26ed_462e_a4f5_8b3652945668.slice/crio-4efa9acf6e43300ac1775ba8bd045cb31b03dccca0ca07cae3b2da86de28fd16 WatchSource:0}: Error finding container 4efa9acf6e43300ac1775ba8bd045cb31b03dccca0ca07cae3b2da86de28fd16: Status 404 returned error can't find the container with id 4efa9acf6e43300ac1775ba8bd045cb31b03dccca0ca07cae3b2da86de28fd16
Sep 19 15:45:00.442832 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:45:00.442809    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7c7934_6213_49e6_96a3_e35450fae73b.slice/crio-d7575633b158a0e77c436ad4b240ddbf40dffdfdb337c8d135195cd604e5d89c WatchSource:0}: Error finding container d7575633b158a0e77c436ad4b240ddbf40dffdfdb337c8d135195cd604e5d89c: Status 404 returned error can't find the container with id d7575633b158a0e77c436ad4b240ddbf40dffdfdb337c8d135195cd604e5d89c
Sep 19 15:45:00.485410 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.485385    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-521326-29830545-cgzxc"]
Sep 19 15:45:00.486557 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:45:00.486532    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2499cba4_02f1_49c2_a700_8b6100df2d16.slice/crio-af9750f04d9c7bc3b31857dbca759e150353ab73e0462e3dfbd77ad669dc1cd0 WatchSource:0}: Error finding container af9750f04d9c7bc3b31857dbca759e150353ab73e0462e3dfbd77ad669dc1cd0: Status 404 returned error can't find the container with id af9750f04d9c7bc3b31857dbca759e150353ab73e0462e3dfbd77ad669dc1cd0
Sep 19 15:45:00.492943 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.492923    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9c5c2-29830545-8ct8q"]
Sep 19 15:45:00.497540 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:45:00.497517    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31347f30_5b1a_4941_835c_f2610ff75d52.slice/crio-90dc9372909b2cd8d6fb5e95dff8d4bb121ba2db5e5650c241d4c8a6d7a06aca WatchSource:0}: Error finding container 90dc9372909b2cd8d6fb5e95dff8d4bb121ba2db5e5650c241d4c8a6d7a06aca: Status 404 returned error can't find the container with id 90dc9372909b2cd8d6fb5e95dff8d4bb121ba2db5e5650c241d4c8a6d7a06aca
Sep 19 15:45:00.551337 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.551307    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830545-krcdm" event={"ID":"bb7c7934-6213-49e6-96a3-e35450fae73b","Type":"ContainerStarted","Data":"d7575633b158a0e77c436ad4b240ddbf40dffdfdb337c8d135195cd604e5d89c"}
Sep 19 15:45:00.552485 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.552465    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-521326-29830545-cgzxc" event={"ID":"2499cba4-02f1-49c2-a700-8b6100df2d16","Type":"ContainerStarted","Data":"af9750f04d9c7bc3b31857dbca759e150353ab73e0462e3dfbd77ad669dc1cd0"}
Sep 19 15:45:00.553593 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.553567    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-30ef69-29830545-xdn5p" event={"ID":"f6baf3e1-26ed-462e-a4f5-8b3652945668","Type":"ContainerStarted","Data":"4efa9acf6e43300ac1775ba8bd045cb31b03dccca0ca07cae3b2da86de28fd16"}
Sep 19 15:45:00.554666 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:00.554648    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9c5c2-29830545-8ct8q" event={"ID":"31347f30-5b1a-4941-835c-f2610ff75d52","Type":"ContainerStarted","Data":"90dc9372909b2cd8d6fb5e95dff8d4bb121ba2db5e5650c241d4c8a6d7a06aca"}
Sep 19 15:45:01.561538 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:01.561506    2562 generic.go:356] "Generic (PLEG): container finished" podID="bb7c7934-6213-49e6-96a3-e35450fae73b" containerID="f5d24d3aa79784b8e8488bc18ad485231d15e3a69e5091471d54628214924744" exitCode=0
Sep 19 15:45:01.561857 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:01.561592    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830545-krcdm" event={"ID":"bb7c7934-6213-49e6-96a3-e35450fae73b","Type":"ContainerDied","Data":"f5d24d3aa79784b8e8488bc18ad485231d15e3a69e5091471d54628214924744"}
Sep 19 15:45:01.563348 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:01.563329    2562 generic.go:356] "Generic (PLEG): container finished" podID="2499cba4-02f1-49c2-a700-8b6100df2d16" containerID="055904af7406448b96039871aef183f88c3a242bb8752dfff83af9447a6068b2" exitCode=0
Sep 19 15:45:01.563464 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:01.563401    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-521326-29830545-cgzxc" event={"ID":"2499cba4-02f1-49c2-a700-8b6100df2d16","Type":"ContainerDied","Data":"055904af7406448b96039871aef183f88c3a242bb8752dfff83af9447a6068b2"}
Sep 19 15:45:01.565016 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:01.564998    2562 generic.go:356] "Generic (PLEG): container finished" podID="f6baf3e1-26ed-462e-a4f5-8b3652945668" containerID="2826e3457f8deeaa478325f02a89fe090647fe04fef197b00f719c50a3c5bde0" exitCode=0
Sep 19 15:45:01.565096 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:01.565070    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-30ef69-29830545-xdn5p" event={"ID":"f6baf3e1-26ed-462e-a4f5-8b3652945668","Type":"ContainerDied","Data":"2826e3457f8deeaa478325f02a89fe090647fe04fef197b00f719c50a3c5bde0"}
Sep 19 15:45:01.566543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:01.566525    2562 generic.go:356] "Generic (PLEG): container finished" podID="31347f30-5b1a-4941-835c-f2610ff75d52" containerID="d81f64d775f758958ab3136a566d36ed50310e7bd7f83b900c6a80995cf61af2" exitCode=0
Sep 19 15:45:01.566633 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:01.566576    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9c5c2-29830545-8ct8q" event={"ID":"31347f30-5b1a-4941-835c-f2610ff75d52","Type":"ContainerDied","Data":"d81f64d775f758958ab3136a566d36ed50310e7bd7f83b900c6a80995cf61af2"}
Sep 19 15:45:02.713353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:02.713324    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830545-krcdm"
Sep 19 15:45:02.753216 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:02.747165    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-30ef69-29830545-xdn5p"
Sep 19 15:45:02.800157 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:02.800133    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9c5c2-29830545-8ct8q"
Sep 19 15:45:02.803284 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:02.803266    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-521326-29830545-cgzxc"
Sep 19 15:45:03.578915 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:03.578889    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9c5c2-29830545-8ct8q"
Sep 19 15:45:03.579065 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:03.578933    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9c5c2-29830545-8ct8q" event={"ID":"31347f30-5b1a-4941-835c-f2610ff75d52","Type":"ContainerDied","Data":"90dc9372909b2cd8d6fb5e95dff8d4bb121ba2db5e5650c241d4c8a6d7a06aca"}
Sep 19 15:45:03.579065 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:03.578985    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90dc9372909b2cd8d6fb5e95dff8d4bb121ba2db5e5650c241d4c8a6d7a06aca"
Sep 19 15:45:03.580364 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:03.580342    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830545-krcdm"
Sep 19 15:45:03.580493 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:03.580392    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830545-krcdm" event={"ID":"bb7c7934-6213-49e6-96a3-e35450fae73b","Type":"ContainerDied","Data":"d7575633b158a0e77c436ad4b240ddbf40dffdfdb337c8d135195cd604e5d89c"}
Sep 19 15:45:03.580493 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:03.580464    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7575633b158a0e77c436ad4b240ddbf40dffdfdb337c8d135195cd604e5d89c"
Sep 19 15:45:03.581912 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:03.581892    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-521326-29830545-cgzxc"
Sep 19 15:45:03.582040 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:03.581925    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-521326-29830545-cgzxc" event={"ID":"2499cba4-02f1-49c2-a700-8b6100df2d16","Type":"ContainerDied","Data":"af9750f04d9c7bc3b31857dbca759e150353ab73e0462e3dfbd77ad669dc1cd0"}
Sep 19 15:45:03.582040 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:03.581964    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af9750f04d9c7bc3b31857dbca759e150353ab73e0462e3dfbd77ad669dc1cd0"
Sep 19 15:45:03.583565 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:03.583542    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-30ef69-29830545-xdn5p" event={"ID":"f6baf3e1-26ed-462e-a4f5-8b3652945668","Type":"ContainerDied","Data":"4efa9acf6e43300ac1775ba8bd045cb31b03dccca0ca07cae3b2da86de28fd16"}
Sep 19 15:45:03.583565 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:03.583565    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-30ef69-29830545-xdn5p"
Sep 19 15:45:03.583738 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:03.583585    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4efa9acf6e43300ac1775ba8bd045cb31b03dccca0ca07cae3b2da86de28fd16"
Sep 19 15:45:04.629110 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.629082    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"]
Sep 19 15:45:04.629612 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.629585    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6baf3e1-26ed-462e-a4f5-8b3652945668" containerName="cleanup"
Sep 19 15:45:04.629612 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.629608    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6baf3e1-26ed-462e-a4f5-8b3652945668" containerName="cleanup"
Sep 19 15:45:04.629720 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.629646    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31347f30-5b1a-4941-835c-f2610ff75d52" containerName="cleanup"
Sep 19 15:45:04.629720 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.629657    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="31347f30-5b1a-4941-835c-f2610ff75d52" containerName="cleanup"
Sep 19 15:45:04.629720 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.629673    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb7c7934-6213-49e6-96a3-e35450fae73b" containerName="cleanup"
Sep 19 15:45:04.629720 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.629681    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb7c7934-6213-49e6-96a3-e35450fae73b" containerName="cleanup"
Sep 19 15:45:04.629720 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.629702    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2499cba4-02f1-49c2-a700-8b6100df2d16" containerName="cleanup"
Sep 19 15:45:04.629720 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.629711    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2499cba4-02f1-49c2-a700-8b6100df2d16" containerName="cleanup"
Sep 19 15:45:04.629905 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.629796    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6baf3e1-26ed-462e-a4f5-8b3652945668" containerName="cleanup"
Sep 19 15:45:04.629905 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.629805    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb7c7934-6213-49e6-96a3-e35450fae73b" containerName="cleanup"
Sep 19 15:45:04.629905 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.629811    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="31347f30-5b1a-4941-835c-f2610ff75d52" containerName="cleanup"
Sep 19 15:45:04.629905 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.629821    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2499cba4-02f1-49c2-a700-8b6100df2d16" containerName="cleanup"
Sep 19 15:45:04.631825 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.631810    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.634805 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.634785    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-521326\"/\"default-dockercfg-g8ftx\""
Sep 19 15:45:04.634942 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.634840    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-521326\"/\"kube-root-ca.crt\""
Sep 19 15:45:04.634942 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.634914    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-521326\"/\"ipp-route-521326-kserve-self-signed-certs\""
Sep 19 15:45:04.635070 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.634847    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-521326\"/\"openshift-service-ca.crt\""
Sep 19 15:45:04.643099 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.643080    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"]
Sep 19 15:45:04.650338 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.650313    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:45:04.784592 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.784569    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-dshm\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.784732 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.784600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-model-cache\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.784732 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.784671    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fd8c673-c22c-439a-950f-b3bd29293d41-tls-certs\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.784898 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.784732    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-tmp-dir\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.784898 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.784807    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwtxp\" (UniqueName: \"kubernetes.io/projected/0fd8c673-c22c-439a-950f-b3bd29293d41-kube-api-access-lwtxp\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.784898 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.784839    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-home\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.886231 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.886145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fd8c673-c22c-439a-950f-b3bd29293d41-tls-certs\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.886231 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.886186    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-tmp-dir\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.886421 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.886254    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwtxp\" (UniqueName: \"kubernetes.io/projected/0fd8c673-c22c-439a-950f-b3bd29293d41-kube-api-access-lwtxp\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.886421 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.886286    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-home\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.886421 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.886348    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-dshm\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.886421 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.886366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-model-cache\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.886702 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.886676    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-tmp-dir\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.886801 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.886722    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-home\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.886801 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.886743    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-model-cache\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.888624 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.888605    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-dshm\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.889129 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.889115    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fd8c673-c22c-439a-950f-b3bd29293d41-tls-certs\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.894004 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.893979    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwtxp\" (UniqueName: \"kubernetes.io/projected/0fd8c673-c22c-439a-950f-b3bd29293d41-kube-api-access-lwtxp\") pod \"ipp-route-521326-kserve-79564bc4f5-cf8jr\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") " pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:04.940765 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:04.940736    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:05.212741 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:05.212716    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"]
Sep 19 15:45:05.214263 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:45:05.214231    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fd8c673_c22c_439a_950f_b3bd29293d41.slice/crio-d85342d4860bff486e527eafb5dff0d92f17adcb0200dedeb648fb67d220eacd WatchSource:0}: Error finding container d85342d4860bff486e527eafb5dff0d92f17adcb0200dedeb648fb67d220eacd: Status 404 returned error can't find the container with id d85342d4860bff486e527eafb5dff0d92f17adcb0200dedeb648fb67d220eacd
Sep 19 15:45:05.599669 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:05.599639    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr" event={"ID":"0fd8c673-c22c-439a-950f-b3bd29293d41","Type":"ContainerStarted","Data":"995ec1ad92df351a8a9cd5858aea60ae788ada29c1669ca63f4fca5712aa18ff"}
Sep 19 15:45:05.599861 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:05.599689    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr" event={"ID":"0fd8c673-c22c-439a-950f-b3bd29293d41","Type":"ContainerStarted","Data":"d85342d4860bff486e527eafb5dff0d92f17adcb0200dedeb648fb67d220eacd"}
Sep 19 15:45:05.615504 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:05.615457    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr" podStartSLOduration=1.615443105 podStartE2EDuration="1.615443105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:45:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:45:05.613400258 +0000 UTC m=+1968.776815300" watchObservedRunningTime="2026-09-19 15:45:05.615443105 +0000 UTC m=+1968.778858144"
Sep 19 15:45:09.043032 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:09.042961    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:45:14.941578 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:14.941535    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:14.942059 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:14.941591    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:14.954046 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:14.954021    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:15.666243 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:15.666212    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:45:17.929368 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:17.929340    2562 scope.go:117] "RemoveContainer" containerID="16f04f781d8d696b526579fe75763947e5b361d87fe5b8f44771d343b6d238ab"
Sep 19 15:45:17.937878 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:17.937853    2562 scope.go:117] "RemoveContainer" containerID="6d2a7a640ff506a6f6c292885395ed7d2fb110d7822963cfc82e6c59313cc77a"
Sep 19 15:45:53.547183 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:45:53.547147    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:46:00.795030 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:00.794993    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:01.058740 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.058646    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"]
Sep 19 15:46:01.062558 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.062540    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.065396 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.065378    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-fa8af0-openshift-default-dockercfg-jpf9x\""
Sep 19 15:46:01.076316 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.076292    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"]
Sep 19 15:46:01.090599 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.090577    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:01.096871 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.096850    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a755c0e1-9f63-44e3-a227-e80e13472aaa-istiod-ca-cert\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.096964 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.096878    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-data\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.096964 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.096946    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-envoy\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.096964 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.096962    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-token\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.097131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.096986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn5vj\" (UniqueName: \"kubernetes.io/projected/a755c0e1-9f63-44e3-a227-e80e13472aaa-kube-api-access-qn5vj\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.097189 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.097125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-workload-socket\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.097189 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.097170    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-workload-certs\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.097319 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.097229    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-podinfo\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.097319 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.097259    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-credential-socket\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.197900 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.197866    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-envoy\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.198097 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.197907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-token\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.198097 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.197932    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn5vj\" (UniqueName: \"kubernetes.io/projected/a755c0e1-9f63-44e3-a227-e80e13472aaa-kube-api-access-qn5vj\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.198097 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.198070    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-workload-socket\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.198323 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.198111    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-workload-certs\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.198323 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.198134    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-podinfo\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.198323 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.198161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-credential-socket\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.198323 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.198218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a755c0e1-9f63-44e3-a227-e80e13472aaa-istiod-ca-cert\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.198323 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.198242    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-data\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.198576 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.198494    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-workload-socket\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.198636 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.198614    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-workload-certs\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.198705 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.198649    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-data\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.198862 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.198841    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-credential-socket\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.199116 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.198936    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a755c0e1-9f63-44e3-a227-e80e13472aaa-istiod-ca-cert\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.200406 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.200381    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-envoy\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.200696 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.200671    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-podinfo\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.206489 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.206462    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-token\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.206623 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.206606    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn5vj\" (UniqueName: \"kubernetes.io/projected/a755c0e1-9f63-44e3-a227-e80e13472aaa-kube-api-access-qn5vj\") pod \"e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") " pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.255621 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.255592    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:01.374424 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.374340    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:01.652138 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.652112    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"]
Sep 19 15:46:01.653711 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:46:01.653683    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda755c0e1_9f63_44e3_a227_e80e13472aaa.slice/crio-1d9aae03d2dd6246ef125eab9c197d355b99577c2c4a2166184aa624793cb9a6 WatchSource:0}: Error finding container 1d9aae03d2dd6246ef125eab9c197d355b99577c2c4a2166184aa624793cb9a6: Status 404 returned error can't find the container with id 1d9aae03d2dd6246ef125eab9c197d355b99577c2c4a2166184aa624793cb9a6
Sep 19 15:46:01.656020 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.655990    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:46:01.656084 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.656054    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:46:01.656121 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.656083    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:46:01.909307 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.909218    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj" event={"ID":"a755c0e1-9f63-44e3-a227-e80e13472aaa","Type":"ContainerStarted","Data":"9b44f68d3f1ccb39fd32f87165cdd9534978c778af3d2ec817f958ab4baf8e80"}
Sep 19 15:46:01.909307 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.909280    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj" event={"ID":"a755c0e1-9f63-44e3-a227-e80e13472aaa","Type":"ContainerStarted","Data":"1d9aae03d2dd6246ef125eab9c197d355b99577c2c4a2166184aa624793cb9a6"}
Sep 19 15:46:01.930121 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:01.930075    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj" podStartSLOduration=0.930061504 podStartE2EDuration="930.061504ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:46:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:46:01.927004856 +0000 UTC m=+2025.090419895" watchObservedRunningTime="2026-09-19 15:46:01.930061504 +0000 UTC m=+2025.093476544"
Sep 19 15:46:02.375531 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:02.375501    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:02.379999 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:02.379975    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:02.914864 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:02.914826    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:02.915591 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:02.915576    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:03.259459 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:03.259379    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:03.789394 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:03.789358    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:03.893153 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:03.893125    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:03.992773 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:03.992739    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:04.670387 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:04.670351    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:05.345371 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:05.345338    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:05.960211 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:05.960174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:06.686411 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:06.686358    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:06.739835 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:06.739804    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:07.147828 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:07.147796    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:07.310738 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:07.310707    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:07.405413 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:07.405337    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:11.727841 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:11.727799    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:11.782942 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:11.782914    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:12.846353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:12.846321    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:46:16.530243 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:16.530189    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:23.037655 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:23.037621    2562 generic.go:356] "Generic (PLEG): container finished" podID="a755c0e1-9f63-44e3-a227-e80e13472aaa" containerID="9b44f68d3f1ccb39fd32f87165cdd9534978c778af3d2ec817f958ab4baf8e80" exitCode=0
Sep 19 15:46:23.038068 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:23.037695    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj" event={"ID":"a755c0e1-9f63-44e3-a227-e80e13472aaa","Type":"ContainerDied","Data":"9b44f68d3f1ccb39fd32f87165cdd9534978c778af3d2ec817f958ab4baf8e80"}
Sep 19 15:46:23.038112 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:23.038073    2562 scope.go:117] "RemoveContainer" containerID="9b44f68d3f1ccb39fd32f87165cdd9534978c778af3d2ec817f958ab4baf8e80"
Sep 19 15:46:23.039343 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:23.039317    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:46:23.039413 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:23.039390    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:46:23.039451 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:23.039424    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 19 15:46:24.045538 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:24.045509    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj" event={"ID":"a755c0e1-9f63-44e3-a227-e80e13472aaa","Type":"ContainerStarted","Data":"8c44590f445ee0860fc7fc6f93d98e0304602e7a6a5a6b58b0795ff53e61c1ee"}
Sep 19 15:46:24.375044 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:24.374972    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:24.375265 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:24.375121    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 19 15:46:24.375265 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:24.375177    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj" podUID="a755c0e1-9f63-44e3-a227-e80e13472aaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 19 15:46:25.375204 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:25.375171    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 19 15:46:25.375619 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:25.375248    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj" podUID="a755c0e1-9f63-44e3-a227-e80e13472aaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 19 15:46:26.375328 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:26.375285    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 19 15:46:26.375799 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:26.375351    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj" podUID="a755c0e1-9f63-44e3-a227-e80e13472aaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 19 15:46:27.374848 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:27.374815    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 19 15:46:27.375030 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:27.374870    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj" podUID="a755c0e1-9f63-44e3-a227-e80e13472aaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 19 15:46:28.086353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:28.086327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:28.375526 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:28.375448    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 19 15:46:28.375526 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:28.375512    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj" podUID="a755c0e1-9f63-44e3-a227-e80e13472aaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 19 15:46:29.256175 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:29.256138    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:29.375035 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:29.375001    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 19 15:46:29.375231 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:29.375055    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj" podUID="a755c0e1-9f63-44e3-a227-e80e13472aaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 19 15:46:29.873589 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:29.873551    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:30.379538 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:30.379510    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:30.379920 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:30.379895    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:30.380577 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:30.380560    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:30.661015 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:30.660927    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:31.447210 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:31.447174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:31.962275 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:31.962247    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:32.673410 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:32.673355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:33.933667 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:33.933627    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:34.592159 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:34.592125    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n"]
Sep 19 15:46:34.595820 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:34.595804    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n"
Sep 19 15:46:34.597902 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:34.597883    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7znsl\""
Sep 19 15:46:34.598010 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:34.597886    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 15:46:34.603689 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:34.603444    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n"]
Sep 19 15:46:34.626434 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:34.626408    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57786943-ac4e-439d-9e63-e5afcb2a1add-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n\" (UID: \"57786943-ac4e-439d-9e63-e5afcb2a1add\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n"
Sep 19 15:46:34.727354 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:34.727333    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57786943-ac4e-439d-9e63-e5afcb2a1add-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n\" (UID: \"57786943-ac4e-439d-9e63-e5afcb2a1add\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n"
Sep 19 15:46:34.727951 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:34.727930    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57786943-ac4e-439d-9e63-e5afcb2a1add-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n\" (UID: \"57786943-ac4e-439d-9e63-e5afcb2a1add\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n"
Sep 19 15:46:34.908567 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:34.908498    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n"
Sep 19 15:46:35.178923 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:35.178901    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n"]
Sep 19 15:46:35.181490 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:46:35.181460    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57786943_ac4e_439d_9e63_e5afcb2a1add.slice/crio-a5bce1c6d27ff01d5d8b7106001d1d722690ce9c0920ccbe359a7bf5b668a59e WatchSource:0}: Error finding container a5bce1c6d27ff01d5d8b7106001d1d722690ce9c0920ccbe359a7bf5b668a59e: Status 404 returned error can't find the container with id a5bce1c6d27ff01d5d8b7106001d1d722690ce9c0920ccbe359a7bf5b668a59e
Sep 19 15:46:35.310143 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:35.310116    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:36.059470 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:36.059435    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:36.120841 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:36.120806    2562 generic.go:356] "Generic (PLEG): container finished" podID="57786943-ac4e-439d-9e63-e5afcb2a1add" containerID="250541666a82b9f72e4f0cb63e6286859fdd591349267a08806b9d021191fbed" exitCode=0
Sep 19 15:46:36.120972 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:36.120876    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n" event={"ID":"57786943-ac4e-439d-9e63-e5afcb2a1add","Type":"ContainerDied","Data":"250541666a82b9f72e4f0cb63e6286859fdd591349267a08806b9d021191fbed"}
Sep 19 15:46:36.120972 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:36.120922    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n" event={"ID":"57786943-ac4e-439d-9e63-e5afcb2a1add","Type":"ContainerStarted","Data":"a5bce1c6d27ff01d5d8b7106001d1d722690ce9c0920ccbe359a7bf5b668a59e"}
Sep 19 15:46:36.573076 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:36.573037    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:37.257430 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:37.257405    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:37.259380 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:37.259358    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n"
Sep 19 15:46:37.351486 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:37.351457    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57786943-ac4e-439d-9e63-e5afcb2a1add-maas-api-service-ca\") pod \"57786943-ac4e-439d-9e63-e5afcb2a1add\" (UID: \"57786943-ac4e-439d-9e63-e5afcb2a1add\") "
Sep 19 15:46:37.351833 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:37.351812    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57786943-ac4e-439d-9e63-e5afcb2a1add-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "57786943-ac4e-439d-9e63-e5afcb2a1add" (UID: "57786943-ac4e-439d-9e63-e5afcb2a1add"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:46:37.453133 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:37.453052    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57786943-ac4e-439d-9e63-e5afcb2a1add-maas-api-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:46:37.859978 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:37.859935    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:38.132352 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:38.132283    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n"
Sep 19 15:46:38.132352 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:38.132332    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n" event={"ID":"57786943-ac4e-439d-9e63-e5afcb2a1add","Type":"ContainerDied","Data":"a5bce1c6d27ff01d5d8b7106001d1d722690ce9c0920ccbe359a7bf5b668a59e"}
Sep 19 15:46:38.132533 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:38.132380    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5bce1c6d27ff01d5d8b7106001d1d722690ce9c0920ccbe359a7bf5b668a59e"
Sep 19 15:46:38.462635 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:38.462557    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:45.565223 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:45.565172    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:45.631396 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:45.631364    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:45.686342 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:45.686311    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:45.744516 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:45.744487    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n"]
Sep 19 15:46:45.749772 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:45.749748    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa8af0-zkw4n"]
Sep 19 15:46:45.749912 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:45.749860    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:45.807369 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:45.807342    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:46.172067 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:46.172032    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:46.268170 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:46.268138    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:46.827494 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:46.827457    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:47.344443 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:47.344406    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57786943-ac4e-439d-9e63-e5afcb2a1add" path="/var/lib/kubelet/pods/57786943-ac4e-439d-9e63-e5afcb2a1add/volumes"
Sep 19 15:46:47.572570 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:47.572535    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:48.134440 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:48.134410    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:48.761496 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:48.761467    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:49.460505 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:49.460466    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:50.139895 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:50.139861    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:46:51.882145 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:51.882112    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:51.982573 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:51.982526    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:52.108707 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:52.108662    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"]
Sep 19 15:46:52.108896 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:52.108879    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj" podUID="a755c0e1-9f63-44e3-a227-e80e13472aaa" containerName="istio-proxy" containerID="cri-o://8c44590f445ee0860fc7fc6f93d98e0304602e7a6a5a6b58b0795ff53e61c1ee" gracePeriod=30
Sep 19 15:46:52.130858 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:52.130830    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:55.669459 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:55.669427    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-521326-rnstw"]
Sep 19 15:46:55.669932 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:55.669915    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57786943-ac4e-439d-9e63-e5afcb2a1add" containerName="revoke-keys"
Sep 19 15:46:55.669980 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:55.669935    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="57786943-ac4e-439d-9e63-e5afcb2a1add" containerName="revoke-keys"
Sep 19 15:46:55.670023 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:55.670015    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="57786943-ac4e-439d-9e63-e5afcb2a1add" containerName="revoke-keys"
Sep 19 15:46:55.672860 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:55.672845    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-521326-rnstw"
Sep 19 15:46:55.675242 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:55.675220    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 15:46:55.675366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:55.675281    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7znsl\""
Sep 19 15:46:55.679763 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:55.679724    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-521326-rnstw"]
Sep 19 15:46:55.775136 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:55.775101    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:55.837369 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:55.837339    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ef285f-10fc-4a49-a9af-3356ff29acc4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-521326-rnstw\" (UID: \"26ef285f-10fc-4a49-a9af-3356ff29acc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-521326-rnstw"
Sep 19 15:46:55.938585 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:55.938500    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ef285f-10fc-4a49-a9af-3356ff29acc4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-521326-rnstw\" (UID: \"26ef285f-10fc-4a49-a9af-3356ff29acc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-521326-rnstw"
Sep 19 15:46:55.939118 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:55.939101    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ef285f-10fc-4a49-a9af-3356ff29acc4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-521326-rnstw\" (UID: \"26ef285f-10fc-4a49-a9af-3356ff29acc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-521326-rnstw"
Sep 19 15:46:55.983395 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:55.983370    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-521326-rnstw"
Sep 19 15:46:56.259012 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:56.258987    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-521326-rnstw"]
Sep 19 15:46:56.261129 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:46:56.261106    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ef285f_10fc_4a49_a9af_3356ff29acc4.slice/crio-eec0318dca0285685776d0418becb34b43a3962ed142945e84ffdf3a7729858e WatchSource:0}: Error finding container eec0318dca0285685776d0418becb34b43a3962ed142945e84ffdf3a7729858e: Status 404 returned error can't find the container with id eec0318dca0285685776d0418becb34b43a3962ed142945e84ffdf3a7729858e
Sep 19 15:46:56.595312 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:56.595280    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:57.254457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.254383    2562 generic.go:356] "Generic (PLEG): container finished" podID="a755c0e1-9f63-44e3-a227-e80e13472aaa" containerID="8c44590f445ee0860fc7fc6f93d98e0304602e7a6a5a6b58b0795ff53e61c1ee" exitCode=0
Sep 19 15:46:57.254814 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.254452    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj" event={"ID":"a755c0e1-9f63-44e3-a227-e80e13472aaa","Type":"ContainerDied","Data":"8c44590f445ee0860fc7fc6f93d98e0304602e7a6a5a6b58b0795ff53e61c1ee"}
Sep 19 15:46:57.254814 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.254507    2562 scope.go:117] "RemoveContainer" containerID="9b44f68d3f1ccb39fd32f87165cdd9534978c778af3d2ec817f958ab4baf8e80"
Sep 19 15:46:57.256154 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.256130    2562 generic.go:356] "Generic (PLEG): container finished" podID="26ef285f-10fc-4a49-a9af-3356ff29acc4" containerID="185efcfbbc905075680d1e2b18cd42117462406a8600c30915af2419e89242bc" exitCode=0
Sep 19 15:46:57.256307 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.256186    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-521326-rnstw" event={"ID":"26ef285f-10fc-4a49-a9af-3356ff29acc4","Type":"ContainerDied","Data":"185efcfbbc905075680d1e2b18cd42117462406a8600c30915af2419e89242bc"}
Sep 19 15:46:57.256307 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.256243    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-521326-rnstw" event={"ID":"26ef285f-10fc-4a49-a9af-3356ff29acc4","Type":"ContainerStarted","Data":"eec0318dca0285685776d0418becb34b43a3962ed142945e84ffdf3a7729858e"}
Sep 19 15:46:57.353229 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.353179    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:57.361254 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.361236    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:57.453765 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.453729    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-podinfo\") pod \"a755c0e1-9f63-44e3-a227-e80e13472aaa\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") "
Sep 19 15:46:57.453995 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.453823    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-credential-socket\") pod \"a755c0e1-9f63-44e3-a227-e80e13472aaa\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") "
Sep 19 15:46:57.453995 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.453863    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-workload-certs\") pod \"a755c0e1-9f63-44e3-a227-e80e13472aaa\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") "
Sep 19 15:46:57.453995 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.453898    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-data\") pod \"a755c0e1-9f63-44e3-a227-e80e13472aaa\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") "
Sep 19 15:46:57.453995 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.453924    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-token\") pod \"a755c0e1-9f63-44e3-a227-e80e13472aaa\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") "
Sep 19 15:46:57.453995 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.453954    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn5vj\" (UniqueName: \"kubernetes.io/projected/a755c0e1-9f63-44e3-a227-e80e13472aaa-kube-api-access-qn5vj\") pod \"a755c0e1-9f63-44e3-a227-e80e13472aaa\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") "
Sep 19 15:46:57.454333 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.454002    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-workload-socket\") pod \"a755c0e1-9f63-44e3-a227-e80e13472aaa\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") "
Sep 19 15:46:57.454333 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.454065    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-envoy\") pod \"a755c0e1-9f63-44e3-a227-e80e13472aaa\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") "
Sep 19 15:46:57.454333 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.454092    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a755c0e1-9f63-44e3-a227-e80e13472aaa-istiod-ca-cert\") pod \"a755c0e1-9f63-44e3-a227-e80e13472aaa\" (UID: \"a755c0e1-9f63-44e3-a227-e80e13472aaa\") "
Sep 19 15:46:57.454333 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.454136    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a755c0e1-9f63-44e3-a227-e80e13472aaa" (UID: "a755c0e1-9f63-44e3-a227-e80e13472aaa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:46:57.454333 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.454165    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a755c0e1-9f63-44e3-a227-e80e13472aaa" (UID: "a755c0e1-9f63-44e3-a227-e80e13472aaa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:46:57.454333 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.454317    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-data" (OuterVolumeSpecName: "istio-data") pod "a755c0e1-9f63-44e3-a227-e80e13472aaa" (UID: "a755c0e1-9f63-44e3-a227-e80e13472aaa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:46:57.454647 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.454489    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a755c0e1-9f63-44e3-a227-e80e13472aaa" (UID: "a755c0e1-9f63-44e3-a227-e80e13472aaa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:46:57.454647 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.454545    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a755c0e1-9f63-44e3-a227-e80e13472aaa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a755c0e1-9f63-44e3-a227-e80e13472aaa" (UID: "a755c0e1-9f63-44e3-a227-e80e13472aaa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:46:57.454647 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.454584    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:46:57.454647 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.454601    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:46:57.454647 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.454615    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:46:57.456419 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.456387    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-token" (OuterVolumeSpecName: "istio-token") pod "a755c0e1-9f63-44e3-a227-e80e13472aaa" (UID: "a755c0e1-9f63-44e3-a227-e80e13472aaa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:46:57.456536 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.456476    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a755c0e1-9f63-44e3-a227-e80e13472aaa" (UID: "a755c0e1-9f63-44e3-a227-e80e13472aaa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:46:57.456536 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.456502    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a755c0e1-9f63-44e3-a227-e80e13472aaa" (UID: "a755c0e1-9f63-44e3-a227-e80e13472aaa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:46:57.456612 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.456532    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a755c0e1-9f63-44e3-a227-e80e13472aaa-kube-api-access-qn5vj" (OuterVolumeSpecName: "kube-api-access-qn5vj") pod "a755c0e1-9f63-44e3-a227-e80e13472aaa" (UID: "a755c0e1-9f63-44e3-a227-e80e13472aaa"). InnerVolumeSpecName "kube-api-access-qn5vj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:46:57.555333 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.555301    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:46:57.555333 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.555332    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn5vj\" (UniqueName: \"kubernetes.io/projected/a755c0e1-9f63-44e3-a227-e80e13472aaa-kube-api-access-qn5vj\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:46:57.555527 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.555344    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:46:57.555527 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.555353    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:46:57.555527 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.555361    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a755c0e1-9f63-44e3-a227-e80e13472aaa-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:46:57.555527 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.555369    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a755c0e1-9f63-44e3-a227-e80e13472aaa-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:46:57.976490 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:57.976394    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:58.263182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:58.263110    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"
Sep 19 15:46:58.263182 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:58.263146    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj" event={"ID":"a755c0e1-9f63-44e3-a227-e80e13472aaa","Type":"ContainerDied","Data":"1d9aae03d2dd6246ef125eab9c197d355b99577c2c4a2166184aa624793cb9a6"}
Sep 19 15:46:58.263685 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:58.263218    2562 scope.go:117] "RemoveContainer" containerID="8c44590f445ee0860fc7fc6f93d98e0304602e7a6a5a6b58b0795ff53e61c1ee"
Sep 19 15:46:58.287584 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:58.287554    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"]
Sep 19 15:46:58.290989 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:58.290961    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj"]
Sep 19 15:46:58.409678 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:58.409654    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-521326-rnstw"
Sep 19 15:46:58.564868 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:58.564839    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ef285f-10fc-4a49-a9af-3356ff29acc4-maas-api-service-ca\") pod \"26ef285f-10fc-4a49-a9af-3356ff29acc4\" (UID: \"26ef285f-10fc-4a49-a9af-3356ff29acc4\") "
Sep 19 15:46:58.565154 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:58.565133    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ef285f-10fc-4a49-a9af-3356ff29acc4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "26ef285f-10fc-4a49-a9af-3356ff29acc4" (UID: "26ef285f-10fc-4a49-a9af-3356ff29acc4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:46:58.565245 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:58.565230    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ef285f-10fc-4a49-a9af-3356ff29acc4-maas-api-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:46:58.572296 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:58.572275    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:59.187612 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:59.187580    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:46:59.271504 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:59.271474    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-521326-rnstw" event={"ID":"26ef285f-10fc-4a49-a9af-3356ff29acc4","Type":"ContainerDied","Data":"eec0318dca0285685776d0418becb34b43a3962ed142945e84ffdf3a7729858e"}
Sep 19 15:46:59.271864 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:59.271521    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eec0318dca0285685776d0418becb34b43a3962ed142945e84ffdf3a7729858e"
Sep 19 15:46:59.271864 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:59.271482    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-521326-rnstw"
Sep 19 15:46:59.344242 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:46:59.344189    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a755c0e1-9f63-44e3-a227-e80e13472aaa" path="/var/lib/kubelet/pods/a755c0e1-9f63-44e3-a227-e80e13472aaa/volumes"
Sep 19 15:47:09.046846 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:09.046810    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:47:11.234420 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:11.234371    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-521326-29830545-cgzxc"]
Sep 19 15:47:11.235970 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:11.235945    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-521326-29830545-cgzxc"]
Sep 19 15:47:11.236819 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:11.236791    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:47:11.298499 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:11.298461    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:47:11.343994 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:11.343967    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2499cba4-02f1-49c2-a700-8b6100df2d16" path="/var/lib/kubelet/pods/2499cba4-02f1-49c2-a700-8b6100df2d16/volumes"
Sep 19 15:47:11.399777 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:11.399741    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:47:11.407401 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:11.407375    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-521326-rnstw"]
Sep 19 15:47:11.409602 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:11.409582    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-521326-rnstw"]
Sep 19 15:47:11.499542 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:11.499435    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:47:11.789306 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:11.789276    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:47:11.894618 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:11.894585    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:47:12.427910 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:12.427875    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:47:13.068066 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:13.068034    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:47:13.344316 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:13.344236    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26ef285f-10fc-4a49-a9af-3356ff29acc4" path="/var/lib/kubelet/pods/26ef285f-10fc-4a49-a9af-3356ff29acc4/volumes"
Sep 19 15:47:13.750582 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:13.750491    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:47:16.767209 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:16.767164    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"]
Sep 19 15:47:16.815160 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:16.815133    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:47:20.636681 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:20.636633    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:47:31.786509 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:31.786471    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr" podUID="0fd8c673-c22c-439a-950f-b3bd29293d41" containerName="main" containerID="cri-o://995ec1ad92df351a8a9cd5858aea60ae788ada29c1669ca63f4fca5712aa18ff" gracePeriod=45
Sep 19 15:47:32.034785 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.034761    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:47:32.168070 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.167981    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-home\") pod \"0fd8c673-c22c-439a-950f-b3bd29293d41\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") "
Sep 19 15:47:32.168258 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.168080    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fd8c673-c22c-439a-950f-b3bd29293d41-tls-certs\") pod \"0fd8c673-c22c-439a-950f-b3bd29293d41\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") "
Sep 19 15:47:32.168258 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.168113    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwtxp\" (UniqueName: \"kubernetes.io/projected/0fd8c673-c22c-439a-950f-b3bd29293d41-kube-api-access-lwtxp\") pod \"0fd8c673-c22c-439a-950f-b3bd29293d41\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") "
Sep 19 15:47:32.168258 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.168148    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-tmp-dir\") pod \"0fd8c673-c22c-439a-950f-b3bd29293d41\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") "
Sep 19 15:47:32.168258 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.168230    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-home" (OuterVolumeSpecName: "home") pod "0fd8c673-c22c-439a-950f-b3bd29293d41" (UID: "0fd8c673-c22c-439a-950f-b3bd29293d41"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:47:32.168492 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.168283    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-model-cache\") pod \"0fd8c673-c22c-439a-950f-b3bd29293d41\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") "
Sep 19 15:47:32.168492 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.168342    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-dshm\") pod \"0fd8c673-c22c-439a-950f-b3bd29293d41\" (UID: \"0fd8c673-c22c-439a-950f-b3bd29293d41\") "
Sep 19 15:47:32.168492 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.168432    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0fd8c673-c22c-439a-950f-b3bd29293d41" (UID: "0fd8c673-c22c-439a-950f-b3bd29293d41"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:47:32.168492 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.168483    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-model-cache" (OuterVolumeSpecName: "model-cache") pod "0fd8c673-c22c-439a-950f-b3bd29293d41" (UID: "0fd8c673-c22c-439a-950f-b3bd29293d41"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:47:32.168868 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.168760    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-tmp-dir\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:47:32.168868 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.168789    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-model-cache\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:47:32.168868 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.168802    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-home\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:47:32.170477 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.170451    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fd8c673-c22c-439a-950f-b3bd29293d41-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0fd8c673-c22c-439a-950f-b3bd29293d41" (UID: "0fd8c673-c22c-439a-950f-b3bd29293d41"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:47:32.170618 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.170539    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-dshm" (OuterVolumeSpecName: "dshm") pod "0fd8c673-c22c-439a-950f-b3bd29293d41" (UID: "0fd8c673-c22c-439a-950f-b3bd29293d41"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:47:32.170618 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.170600    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fd8c673-c22c-439a-950f-b3bd29293d41-kube-api-access-lwtxp" (OuterVolumeSpecName: "kube-api-access-lwtxp") pod "0fd8c673-c22c-439a-950f-b3bd29293d41" (UID: "0fd8c673-c22c-439a-950f-b3bd29293d41"). InnerVolumeSpecName "kube-api-access-lwtxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:47:32.269529 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.269506    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fd8c673-c22c-439a-950f-b3bd29293d41-tls-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:47:32.269529 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.269527    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwtxp\" (UniqueName: \"kubernetes.io/projected/0fd8c673-c22c-439a-950f-b3bd29293d41-kube-api-access-lwtxp\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:47:32.269665 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.269537    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fd8c673-c22c-439a-950f-b3bd29293d41-dshm\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:47:32.449557 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.449475    2562 generic.go:356] "Generic (PLEG): container finished" podID="0fd8c673-c22c-439a-950f-b3bd29293d41" containerID="995ec1ad92df351a8a9cd5858aea60ae788ada29c1669ca63f4fca5712aa18ff" exitCode=0
Sep 19 15:47:32.449557 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.449516    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"
Sep 19 15:47:32.449728 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.449575    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr" event={"ID":"0fd8c673-c22c-439a-950f-b3bd29293d41","Type":"ContainerDied","Data":"995ec1ad92df351a8a9cd5858aea60ae788ada29c1669ca63f4fca5712aa18ff"}
Sep 19 15:47:32.449728 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.449617    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr" event={"ID":"0fd8c673-c22c-439a-950f-b3bd29293d41","Type":"ContainerDied","Data":"d85342d4860bff486e527eafb5dff0d92f17adcb0200dedeb648fb67d220eacd"}
Sep 19 15:47:32.449728 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.449635    2562 scope.go:117] "RemoveContainer" containerID="995ec1ad92df351a8a9cd5858aea60ae788ada29c1669ca63f4fca5712aa18ff"
Sep 19 15:47:32.466458 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.466439    2562 scope.go:117] "RemoveContainer" containerID="995ec1ad92df351a8a9cd5858aea60ae788ada29c1669ca63f4fca5712aa18ff"
Sep 19 15:47:32.466722 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:47:32.466704    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"995ec1ad92df351a8a9cd5858aea60ae788ada29c1669ca63f4fca5712aa18ff\": container with ID starting with 995ec1ad92df351a8a9cd5858aea60ae788ada29c1669ca63f4fca5712aa18ff not found: ID does not exist" containerID="995ec1ad92df351a8a9cd5858aea60ae788ada29c1669ca63f4fca5712aa18ff"
Sep 19 15:47:32.466784 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.466728    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"995ec1ad92df351a8a9cd5858aea60ae788ada29c1669ca63f4fca5712aa18ff"} err="failed to get container status \"995ec1ad92df351a8a9cd5858aea60ae788ada29c1669ca63f4fca5712aa18ff\": rpc error: code = NotFound desc = could not find container \"995ec1ad92df351a8a9cd5858aea60ae788ada29c1669ca63f4fca5712aa18ff\": container with ID starting with 995ec1ad92df351a8a9cd5858aea60ae788ada29c1669ca63f4fca5712aa18ff not found: ID does not exist"
Sep 19 15:47:32.474800 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.474778    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"]
Sep 19 15:47:32.480466 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:32.480442    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-521326/ipp-route-521326-kserve-79564bc4f5-cf8jr"]
Sep 19 15:47:33.344944 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:33.344910    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fd8c673-c22c-439a-950f-b3bd29293d41" path="/var/lib/kubelet/pods/0fd8c673-c22c-439a-950f-b3bd29293d41/volumes"
Sep 19 15:47:53.469973 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:53.469940    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:47:54.740553 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:54.740520    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:47:59.652244 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:59.652174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:47:59.715716 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:59.715682    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:47:59.925824 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:59.925734    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"]
Sep 19 15:47:59.926030 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:59.926003    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c" podUID="f073bd53-5037-4bb9-a557-36fbadd19659" containerName="istio-proxy" containerID="cri-o://f4aea0027f3cf3ee508b7a28f51ad0ed076278cd7d6095185e81dab5fcf6db91" gracePeriod=30
Sep 19 15:47:59.955471 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:47:59.955420    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:00.281424 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.281344    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq"]
Sep 19 15:48:00.281782 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.281770    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fd8c673-c22c-439a-950f-b3bd29293d41" containerName="main"
Sep 19 15:48:00.281829 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.281785    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fd8c673-c22c-439a-950f-b3bd29293d41" containerName="main"
Sep 19 15:48:00.281829 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.281797    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a755c0e1-9f63-44e3-a227-e80e13472aaa" containerName="istio-proxy"
Sep 19 15:48:00.281829 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.281802    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a755c0e1-9f63-44e3-a227-e80e13472aaa" containerName="istio-proxy"
Sep 19 15:48:00.281829 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.281810    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26ef285f-10fc-4a49-a9af-3356ff29acc4" containerName="revoke-keys"
Sep 19 15:48:00.281829 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.281815    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="26ef285f-10fc-4a49-a9af-3356ff29acc4" containerName="revoke-keys"
Sep 19 15:48:00.281982 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.281889    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="26ef285f-10fc-4a49-a9af-3356ff29acc4" containerName="revoke-keys"
Sep 19 15:48:00.281982 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.281898    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a755c0e1-9f63-44e3-a227-e80e13472aaa" containerName="istio-proxy"
Sep 19 15:48:00.281982 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.281904    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a755c0e1-9f63-44e3-a227-e80e13472aaa" containerName="istio-proxy"
Sep 19 15:48:00.281982 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.281916    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fd8c673-c22c-439a-950f-b3bd29293d41" containerName="main"
Sep 19 15:48:00.284950 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.284932    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq"
Sep 19 15:48:00.287149 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.287123    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 15:48:00.287309 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.287127    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7znsl\""
Sep 19 15:48:00.291288 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.291258    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq"]
Sep 19 15:48:00.318762 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.318731    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6566505-6391-4f54-be74-c1931499c4e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq\" (UID: \"c6566505-6391-4f54-be74-c1931499c4e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq"
Sep 19 15:48:00.419539 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.419496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6566505-6391-4f54-be74-c1931499c4e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq\" (UID: \"c6566505-6391-4f54-be74-c1931499c4e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq"
Sep 19 15:48:00.420123 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.420100    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6566505-6391-4f54-be74-c1931499c4e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq\" (UID: \"c6566505-6391-4f54-be74-c1931499c4e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq"
Sep 19 15:48:00.535689 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.535649    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:00.596777 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.596746    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq"
Sep 19 15:48:00.869963 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:00.869942    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq"]
Sep 19 15:48:00.871811 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:48:00.871785    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6566505_6391_4f54_be74_c1931499c4e4.slice/crio-974401df6948cde435f728dad6e0430041777708c3a98de8b89151e639c15828 WatchSource:0}: Error finding container 974401df6948cde435f728dad6e0430041777708c3a98de8b89151e639c15828: Status 404 returned error can't find the container with id 974401df6948cde435f728dad6e0430041777708c3a98de8b89151e639c15828
Sep 19 15:48:01.260446 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:01.260416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:01.617100 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:01.617066    2562 generic.go:356] "Generic (PLEG): container finished" podID="c6566505-6391-4f54-be74-c1931499c4e4" containerID="bb3900311225b4f0bb1f0840ad57829830bc3e56b3f725279a6eef44fc376174" exitCode=0
Sep 19 15:48:01.617231 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:01.617147    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq" event={"ID":"c6566505-6391-4f54-be74-c1931499c4e4","Type":"ContainerDied","Data":"bb3900311225b4f0bb1f0840ad57829830bc3e56b3f725279a6eef44fc376174"}
Sep 19 15:48:01.617231 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:01.617211    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq" event={"ID":"c6566505-6391-4f54-be74-c1931499c4e4","Type":"ContainerStarted","Data":"974401df6948cde435f728dad6e0430041777708c3a98de8b89151e639c15828"}
Sep 19 15:48:01.899398 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:01.899313    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:02.523208 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:02.523159    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:02.761670 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:02.761649    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq"
Sep 19 15:48:02.842857 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:02.842828    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6566505-6391-4f54-be74-c1931499c4e4-maas-api-service-ca\") pod \"c6566505-6391-4f54-be74-c1931499c4e4\" (UID: \"c6566505-6391-4f54-be74-c1931499c4e4\") "
Sep 19 15:48:02.843173 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:02.843151    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6566505-6391-4f54-be74-c1931499c4e4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c6566505-6391-4f54-be74-c1931499c4e4" (UID: "c6566505-6391-4f54-be74-c1931499c4e4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:48:02.944128 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:02.944099    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6566505-6391-4f54-be74-c1931499c4e4-maas-api-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:03.069525 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:03.069497    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:03.630296 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:03.630214    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq"
Sep 19 15:48:03.630296 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:03.630235    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq" event={"ID":"c6566505-6391-4f54-be74-c1931499c4e4","Type":"ContainerDied","Data":"974401df6948cde435f728dad6e0430041777708c3a98de8b89151e639c15828"}
Sep 19 15:48:03.630296 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:03.630288    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="974401df6948cde435f728dad6e0430041777708c3a98de8b89151e639c15828"
Sep 19 15:48:05.179138 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.179109    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:48:05.264780 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.264686    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6q68\" (UniqueName: \"kubernetes.io/projected/f073bd53-5037-4bb9-a557-36fbadd19659-kube-api-access-f6q68\") pod \"f073bd53-5037-4bb9-a557-36fbadd19659\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") "
Sep 19 15:48:05.264780 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.264727    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-workload-certs\") pod \"f073bd53-5037-4bb9-a557-36fbadd19659\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") "
Sep 19 15:48:05.264780 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.264746    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-istio-data\") pod \"f073bd53-5037-4bb9-a557-36fbadd19659\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") "
Sep 19 15:48:05.265045 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.264794    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f073bd53-5037-4bb9-a557-36fbadd19659-istio-token\") pod \"f073bd53-5037-4bb9-a557-36fbadd19659\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") "
Sep 19 15:48:05.265045 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.264851    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f073bd53-5037-4bb9-a557-36fbadd19659-istiod-ca-cert\") pod \"f073bd53-5037-4bb9-a557-36fbadd19659\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") "
Sep 19 15:48:05.265045 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.264877    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-credential-socket\") pod \"f073bd53-5037-4bb9-a557-36fbadd19659\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") "
Sep 19 15:48:05.265045 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.265012    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f073bd53-5037-4bb9-a557-36fbadd19659" (UID: "f073bd53-5037-4bb9-a557-36fbadd19659"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:05.265045 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.265031    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f073bd53-5037-4bb9-a557-36fbadd19659-istio-podinfo\") pod \"f073bd53-5037-4bb9-a557-36fbadd19659\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") "
Sep 19 15:48:05.265330 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.265146    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-workload-socket\") pod \"f073bd53-5037-4bb9-a557-36fbadd19659\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") "
Sep 19 15:48:05.265330 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.265156    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-istio-data" (OuterVolumeSpecName: "istio-data") pod "f073bd53-5037-4bb9-a557-36fbadd19659" (UID: "f073bd53-5037-4bb9-a557-36fbadd19659"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:05.265330 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.265175    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f073bd53-5037-4bb9-a557-36fbadd19659" (UID: "f073bd53-5037-4bb9-a557-36fbadd19659"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:05.265330 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.265221    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-istio-envoy\") pod \"f073bd53-5037-4bb9-a557-36fbadd19659\" (UID: \"f073bd53-5037-4bb9-a557-36fbadd19659\") "
Sep 19 15:48:05.265514 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.265305    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f073bd53-5037-4bb9-a557-36fbadd19659-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f073bd53-5037-4bb9-a557-36fbadd19659" (UID: "f073bd53-5037-4bb9-a557-36fbadd19659"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:48:05.265514 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.265410    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f073bd53-5037-4bb9-a557-36fbadd19659" (UID: "f073bd53-5037-4bb9-a557-36fbadd19659"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:05.265631 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.265613    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:05.265679 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.265639    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:05.265679 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.265652    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:05.265679 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.265664    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f073bd53-5037-4bb9-a557-36fbadd19659-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:05.265794 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.265676    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:05.267168 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.267141    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f073bd53-5037-4bb9-a557-36fbadd19659-kube-api-access-f6q68" (OuterVolumeSpecName: "kube-api-access-f6q68") pod "f073bd53-5037-4bb9-a557-36fbadd19659" (UID: "f073bd53-5037-4bb9-a557-36fbadd19659"). InnerVolumeSpecName "kube-api-access-f6q68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:48:05.267366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.267352    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f073bd53-5037-4bb9-a557-36fbadd19659" (UID: "f073bd53-5037-4bb9-a557-36fbadd19659"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:05.267701 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.267683    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f073bd53-5037-4bb9-a557-36fbadd19659-istio-token" (OuterVolumeSpecName: "istio-token") pod "f073bd53-5037-4bb9-a557-36fbadd19659" (UID: "f073bd53-5037-4bb9-a557-36fbadd19659"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:48:05.267701 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.267690    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f073bd53-5037-4bb9-a557-36fbadd19659-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f073bd53-5037-4bb9-a557-36fbadd19659" (UID: "f073bd53-5037-4bb9-a557-36fbadd19659"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:48:05.367033 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.366998    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f073bd53-5037-4bb9-a557-36fbadd19659-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:05.367033 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.367026    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f073bd53-5037-4bb9-a557-36fbadd19659-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:05.367227 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.367039    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6q68\" (UniqueName: \"kubernetes.io/projected/f073bd53-5037-4bb9-a557-36fbadd19659-kube-api-access-f6q68\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:05.367227 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.367051    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f073bd53-5037-4bb9-a557-36fbadd19659-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:05.643686 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.643658    2562 generic.go:356] "Generic (PLEG): container finished" podID="f073bd53-5037-4bb9-a557-36fbadd19659" containerID="f4aea0027f3cf3ee508b7a28f51ad0ed076278cd7d6095185e81dab5fcf6db91" exitCode=0
Sep 19 15:48:05.643876 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.643707    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"
Sep 19 15:48:05.643876 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.643749    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c" event={"ID":"f073bd53-5037-4bb9-a557-36fbadd19659","Type":"ContainerDied","Data":"f4aea0027f3cf3ee508b7a28f51ad0ed076278cd7d6095185e81dab5fcf6db91"}
Sep 19 15:48:05.643876 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.643814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c" event={"ID":"f073bd53-5037-4bb9-a557-36fbadd19659","Type":"ContainerDied","Data":"e57e3b0ab09feacec959b660ff44243669d6bf0a71bbb9e4dec65cab4388994e"}
Sep 19 15:48:05.643876 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.643844    2562 scope.go:117] "RemoveContainer" containerID="f4aea0027f3cf3ee508b7a28f51ad0ed076278cd7d6095185e81dab5fcf6db91"
Sep 19 15:48:05.653375 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.653355    2562 scope.go:117] "RemoveContainer" containerID="7c02e1c3d25d799c1a0a8303e2f8e13dcee86fb9d771708990ce57cc309b9cab"
Sep 19 15:48:05.660810 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.660776    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"]
Sep 19 15:48:05.663006 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.662987    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c"]
Sep 19 15:48:05.663602 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.663586    2562 scope.go:117] "RemoveContainer" containerID="f4aea0027f3cf3ee508b7a28f51ad0ed076278cd7d6095185e81dab5fcf6db91"
Sep 19 15:48:05.663864 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:48:05.663843    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4aea0027f3cf3ee508b7a28f51ad0ed076278cd7d6095185e81dab5fcf6db91\": container with ID starting with f4aea0027f3cf3ee508b7a28f51ad0ed076278cd7d6095185e81dab5fcf6db91 not found: ID does not exist" containerID="f4aea0027f3cf3ee508b7a28f51ad0ed076278cd7d6095185e81dab5fcf6db91"
Sep 19 15:48:05.663956 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.663871    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4aea0027f3cf3ee508b7a28f51ad0ed076278cd7d6095185e81dab5fcf6db91"} err="failed to get container status \"f4aea0027f3cf3ee508b7a28f51ad0ed076278cd7d6095185e81dab5fcf6db91\": rpc error: code = NotFound desc = could not find container \"f4aea0027f3cf3ee508b7a28f51ad0ed076278cd7d6095185e81dab5fcf6db91\": container with ID starting with f4aea0027f3cf3ee508b7a28f51ad0ed076278cd7d6095185e81dab5fcf6db91 not found: ID does not exist"
Sep 19 15:48:05.663956 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.663889    2562 scope.go:117] "RemoveContainer" containerID="7c02e1c3d25d799c1a0a8303e2f8e13dcee86fb9d771708990ce57cc309b9cab"
Sep 19 15:48:05.664131 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:48:05.664116    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c02e1c3d25d799c1a0a8303e2f8e13dcee86fb9d771708990ce57cc309b9cab\": container with ID starting with 7c02e1c3d25d799c1a0a8303e2f8e13dcee86fb9d771708990ce57cc309b9cab not found: ID does not exist" containerID="7c02e1c3d25d799c1a0a8303e2f8e13dcee86fb9d771708990ce57cc309b9cab"
Sep 19 15:48:05.664180 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:05.664134    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c02e1c3d25d799c1a0a8303e2f8e13dcee86fb9d771708990ce57cc309b9cab"} err="failed to get container status \"7c02e1c3d25d799c1a0a8303e2f8e13dcee86fb9d771708990ce57cc309b9cab\": rpc error: code = NotFound desc = could not find container \"7c02e1c3d25d799c1a0a8303e2f8e13dcee86fb9d771708990ce57cc309b9cab\": container with ID starting with 7c02e1c3d25d799c1a0a8303e2f8e13dcee86fb9d771708990ce57cc309b9cab not found: ID does not exist"
Sep 19 15:48:07.344860 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:07.344830    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f073bd53-5037-4bb9-a557-36fbadd19659" path="/var/lib/kubelet/pods/f073bd53-5037-4bb9-a557-36fbadd19659/volumes"
Sep 19 15:48:10.793459 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:10.793427    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-30ef69-29830545-xdn5p"]
Sep 19 15:48:10.797370 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:10.797334    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-30ef69-29830545-xdn5p"]
Sep 19 15:48:10.799292 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:10.799263    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:10.859998 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:10.859968    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:10.927891 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:10.927858    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:10.967895 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:10.967864    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq"]
Sep 19 15:48:10.969864 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:10.969840    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30ef69-fxqkq"]
Sep 19 15:48:10.988620 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:10.988600    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:11.345705 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:11.345663    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6566505-6391-4f54-be74-c1931499c4e4" path="/var/lib/kubelet/pods/c6566505-6391-4f54-be74-c1931499c4e4/volumes"
Sep 19 15:48:11.346044 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:11.346025    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6baf3e1-26ed-462e-a4f5-8b3652945668" path="/var/lib/kubelet/pods/f6baf3e1-26ed-462e-a4f5-8b3652945668/volumes"
Sep 19 15:48:11.356840 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:11.356813    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:11.457432 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:11.457398    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:11.863821 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:11.863786    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:12.569386 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:12.569351    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:13.141560 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:13.141524    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:48:15.709959 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:15.709910    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:17.243697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.243665    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:17.342892 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.342827    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:17.479459 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.479426    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"]
Sep 19 15:48:17.479694 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.479671    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4" podUID="ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" containerName="istio-proxy" containerID="cri-o://7e894ed8935680ed9ea73c53d7e3f4965876c0026181c5654bc22537a211ed4e" gracePeriod=30
Sep 19 15:48:17.503443 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.503369    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:17.832036 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.832006    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7"]
Sep 19 15:48:17.832411 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.832397    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f073bd53-5037-4bb9-a557-36fbadd19659" containerName="istio-proxy"
Sep 19 15:48:17.832464 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.832414    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f073bd53-5037-4bb9-a557-36fbadd19659" containerName="istio-proxy"
Sep 19 15:48:17.832464 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.832435    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6566505-6391-4f54-be74-c1931499c4e4" containerName="revoke-keys"
Sep 19 15:48:17.832464 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.832440    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6566505-6391-4f54-be74-c1931499c4e4" containerName="revoke-keys"
Sep 19 15:48:17.832464 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.832452    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a755c0e1-9f63-44e3-a227-e80e13472aaa" containerName="istio-proxy"
Sep 19 15:48:17.832464 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.832458    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a755c0e1-9f63-44e3-a227-e80e13472aaa" containerName="istio-proxy"
Sep 19 15:48:17.832618 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.832516    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f073bd53-5037-4bb9-a557-36fbadd19659" containerName="istio-proxy"
Sep 19 15:48:17.832618 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.832525    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f073bd53-5037-4bb9-a557-36fbadd19659" containerName="istio-proxy"
Sep 19 15:48:17.832618 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.832530    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6566505-6391-4f54-be74-c1931499c4e4" containerName="revoke-keys"
Sep 19 15:48:17.836975 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.836960    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7"
Sep 19 15:48:17.839519 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.839498    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7znsl\""
Sep 19 15:48:17.839769 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.839749    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 15:48:17.841064 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.841028    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7"]
Sep 19 15:48:17.977942 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.977912    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40269ba1-0b17-43dc-8bd7-f1f407d7789f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7\" (UID: \"40269ba1-0b17-43dc-8bd7-f1f407d7789f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7"
Sep 19 15:48:17.978746 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:17.978721    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:18.078707 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:18.078669    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40269ba1-0b17-43dc-8bd7-f1f407d7789f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7\" (UID: \"40269ba1-0b17-43dc-8bd7-f1f407d7789f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7"
Sep 19 15:48:18.079274 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:18.079255    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40269ba1-0b17-43dc-8bd7-f1f407d7789f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7\" (UID: \"40269ba1-0b17-43dc-8bd7-f1f407d7789f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7"
Sep 19 15:48:18.148777 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:18.148714    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7"
Sep 19 15:48:18.422830 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:18.422803    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7"]
Sep 19 15:48:18.424978 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:48:18.424950    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40269ba1_0b17_43dc_8bd7_f1f407d7789f.slice/crio-46d6f40a4a6011acdc51dcd2eae11fe33582ba2b0fda44067b01141cdcd60d7b WatchSource:0}: Error finding container 46d6f40a4a6011acdc51dcd2eae11fe33582ba2b0fda44067b01141cdcd60d7b: Status 404 returned error can't find the container with id 46d6f40a4a6011acdc51dcd2eae11fe33582ba2b0fda44067b01141cdcd60d7b
Sep 19 15:48:18.645682 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:18.645651    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:18.729648 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:18.729618    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7" event={"ID":"40269ba1-0b17-43dc-8bd7-f1f407d7789f","Type":"ContainerStarted","Data":"e22f0649a9a83d45b3f94d37c0688b9b1a5e5ddf5b98e99b2095936359a40777"}
Sep 19 15:48:18.729799 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:18.729678    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7" event={"ID":"40269ba1-0b17-43dc-8bd7-f1f407d7789f","Type":"ContainerStarted","Data":"46d6f40a4a6011acdc51dcd2eae11fe33582ba2b0fda44067b01141cdcd60d7b"}
Sep 19 15:48:18.746442 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:18.746398    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7" podStartSLOduration=1.746379116 podStartE2EDuration="1.746379116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:48:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:48:18.744072129 +0000 UTC m=+2161.907487171" watchObservedRunningTime="2026-09-19 15:48:18.746379116 +0000 UTC m=+2161.909794158"
Sep 19 15:48:19.261174 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:19.261091    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:19.736242 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:19.736189    2562 generic.go:356] "Generic (PLEG): container finished" podID="40269ba1-0b17-43dc-8bd7-f1f407d7789f" containerID="e22f0649a9a83d45b3f94d37c0688b9b1a5e5ddf5b98e99b2095936359a40777" exitCode=0
Sep 19 15:48:19.736629 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:19.736293    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7" event={"ID":"40269ba1-0b17-43dc-8bd7-f1f407d7789f","Type":"ContainerDied","Data":"e22f0649a9a83d45b3f94d37c0688b9b1a5e5ddf5b98e99b2095936359a40777"}
Sep 19 15:48:19.880121 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:19.880088    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:20.887038 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:20.887014    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7"
Sep 19 15:48:21.008529 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:21.008454    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40269ba1-0b17-43dc-8bd7-f1f407d7789f-maas-api-service-ca\") pod \"40269ba1-0b17-43dc-8bd7-f1f407d7789f\" (UID: \"40269ba1-0b17-43dc-8bd7-f1f407d7789f\") "
Sep 19 15:48:21.008808 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:21.008787    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40269ba1-0b17-43dc-8bd7-f1f407d7789f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "40269ba1-0b17-43dc-8bd7-f1f407d7789f" (UID: "40269ba1-0b17-43dc-8bd7-f1f407d7789f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:48:21.109303 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:21.109270    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40269ba1-0b17-43dc-8bd7-f1f407d7789f-maas-api-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:21.749138 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:21.749048    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7"
Sep 19 15:48:21.749138 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:21.749090    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7" event={"ID":"40269ba1-0b17-43dc-8bd7-f1f407d7789f","Type":"ContainerDied","Data":"46d6f40a4a6011acdc51dcd2eae11fe33582ba2b0fda44067b01141cdcd60d7b"}
Sep 19 15:48:21.749405 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:21.749160    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46d6f40a4a6011acdc51dcd2eae11fe33582ba2b0fda44067b01141cdcd60d7b"
Sep 19 15:48:22.261634 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.261598    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 15:48:22.262009 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.261653    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4" podUID="ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 15:48:22.740891 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.740868    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:48:22.755317 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.755292    2562 generic.go:356] "Generic (PLEG): container finished" podID="ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" containerID="7e894ed8935680ed9ea73c53d7e3f4965876c0026181c5654bc22537a211ed4e" exitCode=0
Sep 19 15:48:22.755462 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.755325    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4" event={"ID":"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1","Type":"ContainerDied","Data":"7e894ed8935680ed9ea73c53d7e3f4965876c0026181c5654bc22537a211ed4e"}
Sep 19 15:48:22.755462 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.755391    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4" event={"ID":"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1","Type":"ContainerDied","Data":"d967ad91d3462ea075f3b9a4f2185e803432ee102adb8677a7347d76b552db07"}
Sep 19 15:48:22.755462 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.755338    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"
Sep 19 15:48:22.755462 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.755426    2562 scope.go:117] "RemoveContainer" containerID="7e894ed8935680ed9ea73c53d7e3f4965876c0026181c5654bc22537a211ed4e"
Sep 19 15:48:22.766579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.766559    2562 scope.go:117] "RemoveContainer" containerID="6772d4686551271fd16df5af725462a64c560c07240c01ce556dcfff403aca4e"
Sep 19 15:48:22.774718 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.774702    2562 scope.go:117] "RemoveContainer" containerID="7e894ed8935680ed9ea73c53d7e3f4965876c0026181c5654bc22537a211ed4e"
Sep 19 15:48:22.775008 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:48:22.774979    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e894ed8935680ed9ea73c53d7e3f4965876c0026181c5654bc22537a211ed4e\": container with ID starting with 7e894ed8935680ed9ea73c53d7e3f4965876c0026181c5654bc22537a211ed4e not found: ID does not exist" containerID="7e894ed8935680ed9ea73c53d7e3f4965876c0026181c5654bc22537a211ed4e"
Sep 19 15:48:22.775059 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.775018    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e894ed8935680ed9ea73c53d7e3f4965876c0026181c5654bc22537a211ed4e"} err="failed to get container status \"7e894ed8935680ed9ea73c53d7e3f4965876c0026181c5654bc22537a211ed4e\": rpc error: code = NotFound desc = could not find container \"7e894ed8935680ed9ea73c53d7e3f4965876c0026181c5654bc22537a211ed4e\": container with ID starting with 7e894ed8935680ed9ea73c53d7e3f4965876c0026181c5654bc22537a211ed4e not found: ID does not exist"
Sep 19 15:48:22.775059 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.775035    2562 scope.go:117] "RemoveContainer" containerID="6772d4686551271fd16df5af725462a64c560c07240c01ce556dcfff403aca4e"
Sep 19 15:48:22.775304 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:48:22.775287    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6772d4686551271fd16df5af725462a64c560c07240c01ce556dcfff403aca4e\": container with ID starting with 6772d4686551271fd16df5af725462a64c560c07240c01ce556dcfff403aca4e not found: ID does not exist" containerID="6772d4686551271fd16df5af725462a64c560c07240c01ce556dcfff403aca4e"
Sep 19 15:48:22.775353 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.775310    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6772d4686551271fd16df5af725462a64c560c07240c01ce556dcfff403aca4e"} err="failed to get container status \"6772d4686551271fd16df5af725462a64c560c07240c01ce556dcfff403aca4e\": rpc error: code = NotFound desc = could not find container \"6772d4686551271fd16df5af725462a64c560c07240c01ce556dcfff403aca4e\": container with ID starting with 6772d4686551271fd16df5af725462a64c560c07240c01ce556dcfff403aca4e not found: ID does not exist"
Sep 19 15:48:22.823656 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.823631    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-token\") pod \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") "
Sep 19 15:48:22.823754 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.823671    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwcv5\" (UniqueName: \"kubernetes.io/projected/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-kube-api-access-bwcv5\") pod \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") "
Sep 19 15:48:22.823754 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.823697    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-podinfo\") pod \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") "
Sep 19 15:48:22.823827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.823812    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-credential-socket\") pod \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") "
Sep 19 15:48:22.823869 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.823850    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-workload-socket\") pod \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") "
Sep 19 15:48:22.823919 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.823890    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istiod-ca-cert\") pod \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") "
Sep 19 15:48:22.823975 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.823954    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-data\") pod \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") "
Sep 19 15:48:22.824114 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.824081    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" (UID: "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:22.824114 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.824093    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" (UID: "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:22.824271 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.824142    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-workload-certs\") pod \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") "
Sep 19 15:48:22.824271 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.824255    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-envoy\") pod \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\" (UID: \"ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1\") "
Sep 19 15:48:22.824383 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.824251    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" (UID: "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:22.824449 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.824385    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" (UID: "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:22.824525 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.824502    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" (UID: "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:48:22.824827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.824768    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:22.824827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.824795    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:22.824827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.824808    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:22.824827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.824824    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:22.824827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.824837    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:22.825986 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.825962    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" (UID: "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:48:22.826079 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.825995    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" (UID: "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:48:22.826079 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.826053    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-kube-api-access-bwcv5" (OuterVolumeSpecName: "kube-api-access-bwcv5") pod "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" (UID: "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1"). InnerVolumeSpecName "kube-api-access-bwcv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:48:22.826486 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.826471    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" (UID: "ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:22.926380 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.926299    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:22.926380 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.926327    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:22.926380 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.926336    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwcv5\" (UniqueName: \"kubernetes.io/projected/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-kube-api-access-bwcv5\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:22.926380 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:22.926344    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:23.080649 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:23.080617    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"]
Sep 19 15:48:23.080815 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:23.080683    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4"]
Sep 19 15:48:23.344349 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:23.344319    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" path="/var/lib/kubelet/pods/ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1/volumes"
Sep 19 15:48:28.247581 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:28.247550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:28.308652 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:28.308615    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:28.368458 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:28.368418    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:28.419712 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:28.419673    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7"]
Sep 19 15:48:28.422016 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:28.421995    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-50372a-grcz7"]
Sep 19 15:48:28.425048 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:28.425029    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:28.479929 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:28.479898    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:28.899367 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:28.899330    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:28.999578 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:28.999543    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:29.344402 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:29.344371    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40269ba1-0b17-43dc-8bd7-f1f407d7789f" path="/var/lib/kubelet/pods/40269ba1-0b17-43dc-8bd7-f1f407d7789f/volumes"
Sep 19 15:48:29.495464 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:29.495417    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:30.140761 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:30.140727    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:48:34.711226 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:34.711166    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:34.811142 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:34.811106    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:34.979331 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:34.979254    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:35.315914 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.315883    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5"]
Sep 19 15:48:35.316346 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.316331    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" containerName="istio-proxy"
Sep 19 15:48:35.316430 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.316348    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" containerName="istio-proxy"
Sep 19 15:48:35.316430 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.316366    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40269ba1-0b17-43dc-8bd7-f1f407d7789f" containerName="revoke-keys"
Sep 19 15:48:35.316430 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.316372    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="40269ba1-0b17-43dc-8bd7-f1f407d7789f" containerName="revoke-keys"
Sep 19 15:48:35.316430 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.316381    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" containerName="istio-proxy"
Sep 19 15:48:35.316430 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.316387    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" containerName="istio-proxy"
Sep 19 15:48:35.316430 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.316395    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f073bd53-5037-4bb9-a557-36fbadd19659" containerName="istio-proxy"
Sep 19 15:48:35.316430 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.316400    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f073bd53-5037-4bb9-a557-36fbadd19659" containerName="istio-proxy"
Sep 19 15:48:35.316690 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.316456    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" containerName="istio-proxy"
Sep 19 15:48:35.316690 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.316465    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="40269ba1-0b17-43dc-8bd7-f1f407d7789f" containerName="revoke-keys"
Sep 19 15:48:35.321045 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.321025    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5"
Sep 19 15:48:35.323532 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.323512    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 15:48:35.323628 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.323516    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7znsl\""
Sep 19 15:48:35.327783 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.327761    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5"]
Sep 19 15:48:35.441344 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.441317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ff215b-18ca-4b0b-b41f-09972a5a5b38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5\" (UID: \"01ff215b-18ca-4b0b-b41f-09972a5a5b38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5"
Sep 19 15:48:35.542499 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.542470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ff215b-18ca-4b0b-b41f-09972a5a5b38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5\" (UID: \"01ff215b-18ca-4b0b-b41f-09972a5a5b38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5"
Sep 19 15:48:35.543082 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.543058    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ff215b-18ca-4b0b-b41f-09972a5a5b38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5\" (UID: \"01ff215b-18ca-4b0b-b41f-09972a5a5b38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5"
Sep 19 15:48:35.575779 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.575715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:35.633727 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.633704    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5"
Sep 19 15:48:35.909654 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:35.909630    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5"]
Sep 19 15:48:35.911794 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:48:35.911767    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ff215b_18ca_4b0b_b41f_09972a5a5b38.slice/crio-d44374872922eb9810cc36f5a7a447fe6412dcc9622b63eebf9bc6db9f08ba5f WatchSource:0}: Error finding container d44374872922eb9810cc36f5a7a447fe6412dcc9622b63eebf9bc6db9f08ba5f: Status 404 returned error can't find the container with id d44374872922eb9810cc36f5a7a447fe6412dcc9622b63eebf9bc6db9f08ba5f
Sep 19 15:48:36.353393 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:36.353354    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:36.839601 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:36.839570    2562 generic.go:356] "Generic (PLEG): container finished" podID="01ff215b-18ca-4b0b-b41f-09972a5a5b38" containerID="7adbb0db83a1a143c42cffa997d3009484f6ba2a558fb130504b0a33f2106115" exitCode=0
Sep 19 15:48:36.839726 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:36.839660    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5" event={"ID":"01ff215b-18ca-4b0b-b41f-09972a5a5b38","Type":"ContainerDied","Data":"7adbb0db83a1a143c42cffa997d3009484f6ba2a558fb130504b0a33f2106115"}
Sep 19 15:48:36.839726 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:36.839712    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5" event={"ID":"01ff215b-18ca-4b0b-b41f-09972a5a5b38","Type":"ContainerStarted","Data":"d44374872922eb9810cc36f5a7a447fe6412dcc9622b63eebf9bc6db9f08ba5f"}
Sep 19 15:48:36.932423 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:36.932392    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:37.978131 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:37.978109    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5"
Sep 19 15:48:38.167095 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:38.167023    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ff215b-18ca-4b0b-b41f-09972a5a5b38-maas-api-service-ca\") pod \"01ff215b-18ca-4b0b-b41f-09972a5a5b38\" (UID: \"01ff215b-18ca-4b0b-b41f-09972a5a5b38\") "
Sep 19 15:48:38.167352 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:38.167331    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ff215b-18ca-4b0b-b41f-09972a5a5b38-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "01ff215b-18ca-4b0b-b41f-09972a5a5b38" (UID: "01ff215b-18ca-4b0b-b41f-09972a5a5b38"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:48:38.267942 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:38.267914    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ff215b-18ca-4b0b-b41f-09972a5a5b38-maas-api-service-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:48:38.851947 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:38.851915    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5"
Sep 19 15:48:38.852120 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:38.851947    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5" event={"ID":"01ff215b-18ca-4b0b-b41f-09972a5a5b38","Type":"ContainerDied","Data":"d44374872922eb9810cc36f5a7a447fe6412dcc9622b63eebf9bc6db9f08ba5f"}
Sep 19 15:48:38.852120 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:38.852012    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d44374872922eb9810cc36f5a7a447fe6412dcc9622b63eebf9bc6db9f08ba5f"
Sep 19 15:48:45.728562 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:45.728530    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9c5c2-29830545-8ct8q"]
Sep 19 15:48:45.732459 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:45.732432    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9c5c2-29830545-8ct8q"]
Sep 19 15:48:45.735424 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:45.735400    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:45.806267 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:45.806228    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:45.906731 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:45.906683    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:45.913059 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:45.913033    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5"]
Sep 19 15:48:45.915305 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:45.915284    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9c5c2-jshc5"]
Sep 19 15:48:45.989774 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:45.989704    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:46.293442 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:46.293416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:46.392370 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:46.392339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:47.345522 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:47.345489    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01ff215b-18ca-4b0b-b41f-09972a5a5b38" path="/var/lib/kubelet/pods/01ff215b-18ca-4b0b-b41f-09972a5a5b38/volumes"
Sep 19 15:48:47.345880 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:47.345749    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31347f30-5b1a-4941-835c-f2610ff75d52" path="/var/lib/kubelet/pods/31347f30-5b1a-4941-835c-f2610ff75d52/volumes"
Sep 19 15:48:48.436414 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:48.436383    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:48:52.262001 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:52.261970    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:52.362555 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:52.362525    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:52.518696 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:52.518621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:48:56.243002 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:48:56.242964    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:49:02.967178 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:49:02.967141    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:49:17.998379 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:49:17.998349    2562 scope.go:117] "RemoveContainer" containerID="ca0fe49b25a4232447897c7ae0587cf100fcce110295e98eb26ca07814e32823"
Sep 19 15:49:18.007249 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:49:18.007230    2562 scope.go:117] "RemoveContainer" containerID="45078eb6d3b51ac2b159e4c835a913e9160a05d3e7ed066bfb55a1c275cbe40a"
Sep 19 15:49:18.015124 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:49:18.015105    2562 scope.go:117] "RemoveContainer" containerID="ed4b1c917480c3ce8ffa70ec3fb966ff5dfdb221b4e9ca7524f3c89690604ab0"
Sep 19 15:49:19.464639 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:49:19.464605    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:49:19.524050 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:49:19.524024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:49:43.866543 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:49:43.866464    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:50:18.049460 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:50:18.049426    2562 scope.go:117] "RemoveContainer" containerID="2c521fb546e4fdcfe6ebb92481b2a8399bcfd201df1c1b152a7864023f49d2d0"
Sep 19 15:50:18.341517 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:50:18.341442    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:50:18.746671 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:50:18.746593    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:50:20.100545 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:50:20.100508    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:50:28.036480 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:50:28.036448    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:50:32.256156 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:50:32.256123    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:50:42.623563 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:50:42.623531    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:50:46.344573 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:50:46.344542    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:50:53.843282 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:50:53.843244    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:51:00.929134 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:00.929101    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:51:00.984573 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:00.984537    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:51:01.040069 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:01.040039    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:51:08.541837 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:08.541750    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:51:18.072051 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:18.072013    2562 scope.go:117] "RemoveContainer" containerID="2826e3457f8deeaa478325f02a89fe090647fe04fef197b00f719c50a3c5bde0"
Sep 19 15:51:18.080633 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:18.080610    2562 scope.go:117] "RemoveContainer" containerID="055904af7406448b96039871aef183f88c3a242bb8752dfff83af9447a6068b2"
Sep 19 15:51:18.088504 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:18.088483    2562 scope.go:117] "RemoveContainer" containerID="d81f64d775f758958ab3136a566d36ed50310e7bd7f83b900c6a80995cf61af2"
Sep 19 15:51:26.143774 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:26.143735    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:51:33.784266 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:33.784222    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"]
Sep 19 15:51:33.784758 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:33.784437    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp" podUID="69b68d9e-2f15-4358-b7c9-be6739375abf" containerName="manager" containerID="cri-o://461327dd43139b81f0040a73f1bc904380410919e715724395f835311e4eac4e" gracePeriod=10
Sep 19 15:51:34.804395 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:34.804367    2562 generic.go:356] "Generic (PLEG): container finished" podID="69b68d9e-2f15-4358-b7c9-be6739375abf" containerID="461327dd43139b81f0040a73f1bc904380410919e715724395f835311e4eac4e" exitCode=0
Sep 19 15:51:34.804778 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:34.804420    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp" event={"ID":"69b68d9e-2f15-4358-b7c9-be6739375abf","Type":"ContainerDied","Data":"461327dd43139b81f0040a73f1bc904380410919e715724395f835311e4eac4e"}
Sep 19 15:51:34.835426 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:34.835403    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"
Sep 19 15:51:34.927422 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:34.927397    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69b68d9e-2f15-4358-b7c9-be6739375abf-extensions-socket-volume\") pod \"69b68d9e-2f15-4358-b7c9-be6739375abf\" (UID: \"69b68d9e-2f15-4358-b7c9-be6739375abf\") "
Sep 19 15:51:34.927569 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:34.927465    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nxld\" (UniqueName: \"kubernetes.io/projected/69b68d9e-2f15-4358-b7c9-be6739375abf-kube-api-access-5nxld\") pod \"69b68d9e-2f15-4358-b7c9-be6739375abf\" (UID: \"69b68d9e-2f15-4358-b7c9-be6739375abf\") "
Sep 19 15:51:34.927820 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:34.927788    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69b68d9e-2f15-4358-b7c9-be6739375abf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "69b68d9e-2f15-4358-b7c9-be6739375abf" (UID: "69b68d9e-2f15-4358-b7c9-be6739375abf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:51:34.929570 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:34.929547    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69b68d9e-2f15-4358-b7c9-be6739375abf-kube-api-access-5nxld" (OuterVolumeSpecName: "kube-api-access-5nxld") pod "69b68d9e-2f15-4358-b7c9-be6739375abf" (UID: "69b68d9e-2f15-4358-b7c9-be6739375abf"). InnerVolumeSpecName "kube-api-access-5nxld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:51:35.029327 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:35.029258    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69b68d9e-2f15-4358-b7c9-be6739375abf-extensions-socket-volume\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:51:35.029327 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:35.029285    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nxld\" (UniqueName: \"kubernetes.io/projected/69b68d9e-2f15-4358-b7c9-be6739375abf-kube-api-access-5nxld\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:51:35.810813 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:35.810786    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp" event={"ID":"69b68d9e-2f15-4358-b7c9-be6739375abf","Type":"ContainerDied","Data":"49f2755da0cbb630d867bc809f390e4b7bdb052b99e796615e3d48c97a67809f"}
Sep 19 15:51:35.811215 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:35.810842    2562 scope.go:117] "RemoveContainer" containerID="461327dd43139b81f0040a73f1bc904380410919e715724395f835311e4eac4e"
Sep 19 15:51:35.811215 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:35.810794    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"
Sep 19 15:51:35.826551 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:35.826527    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"]
Sep 19 15:51:35.831828 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:35.831808    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9wmhp"]
Sep 19 15:51:37.344914 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:51:37.344884    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69b68d9e-2f15-4358-b7c9-be6739375abf" path="/var/lib/kubelet/pods/69b68d9e-2f15-4358-b7c9-be6739375abf/volumes"
Sep 19 15:52:34.467788 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.467752    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cb9nl"]
Sep 19 15:52:34.468232 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.468126    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69b68d9e-2f15-4358-b7c9-be6739375abf" containerName="manager"
Sep 19 15:52:34.468232 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.468137    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="69b68d9e-2f15-4358-b7c9-be6739375abf" containerName="manager"
Sep 19 15:52:34.468232 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.468168    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ff215b-18ca-4b0b-b41f-09972a5a5b38" containerName="revoke-keys"
Sep 19 15:52:34.468232 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.468174    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ff215b-18ca-4b0b-b41f-09972a5a5b38" containerName="revoke-keys"
Sep 19 15:52:34.468410 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.468251    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec30ae4b-b1a7-41cf-87d4-f4b4a418bab1" containerName="istio-proxy"
Sep 19 15:52:34.468410 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.468261    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="69b68d9e-2f15-4358-b7c9-be6739375abf" containerName="manager"
Sep 19 15:52:34.468410 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.468267    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="01ff215b-18ca-4b0b-b41f-09972a5a5b38" containerName="revoke-keys"
Sep 19 15:52:34.471186 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.471170    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cb9nl"
Sep 19 15:52:34.473289 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.473269    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9vsnk\""
Sep 19 15:52:34.485358 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.485336    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cb9nl"]
Sep 19 15:52:34.543368 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.543347    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a27766f-fc65-46fd-bf37-9a0bbd0e6a29-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cb9nl\" (UID: \"1a27766f-fc65-46fd-bf37-9a0bbd0e6a29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cb9nl"
Sep 19 15:52:34.543481 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.543423    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n68dh\" (UniqueName: \"kubernetes.io/projected/1a27766f-fc65-46fd-bf37-9a0bbd0e6a29-kube-api-access-n68dh\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cb9nl\" (UID: \"1a27766f-fc65-46fd-bf37-9a0bbd0e6a29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cb9nl"
Sep 19 15:52:34.644337 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.644307    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n68dh\" (UniqueName: \"kubernetes.io/projected/1a27766f-fc65-46fd-bf37-9a0bbd0e6a29-kube-api-access-n68dh\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cb9nl\" (UID: \"1a27766f-fc65-46fd-bf37-9a0bbd0e6a29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cb9nl"
Sep 19 15:52:34.644493 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.644368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a27766f-fc65-46fd-bf37-9a0bbd0e6a29-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cb9nl\" (UID: \"1a27766f-fc65-46fd-bf37-9a0bbd0e6a29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cb9nl"
Sep 19 15:52:34.644734 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.644716    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a27766f-fc65-46fd-bf37-9a0bbd0e6a29-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cb9nl\" (UID: \"1a27766f-fc65-46fd-bf37-9a0bbd0e6a29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cb9nl"
Sep 19 15:52:34.651991 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.651972    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n68dh\" (UniqueName: \"kubernetes.io/projected/1a27766f-fc65-46fd-bf37-9a0bbd0e6a29-kube-api-access-n68dh\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cb9nl\" (UID: \"1a27766f-fc65-46fd-bf37-9a0bbd0e6a29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cb9nl"
Sep 19 15:52:34.781387 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:34.781310    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cb9nl"
Sep 19 15:52:35.055566 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:35.055543    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cb9nl"]
Sep 19 15:52:35.057612 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:52:35.057586    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a27766f_fc65_46fd_bf37_9a0bbd0e6a29.slice/crio-ce52b7ba3a640bd7226e072f7ba77c29529ad7cfda173c06dd70ad51ecaa09e7 WatchSource:0}: Error finding container ce52b7ba3a640bd7226e072f7ba77c29529ad7cfda173c06dd70ad51ecaa09e7: Status 404 returned error can't find the container with id ce52b7ba3a640bd7226e072f7ba77c29529ad7cfda173c06dd70ad51ecaa09e7
Sep 19 15:52:35.129339 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:35.129311    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cb9nl" event={"ID":"1a27766f-fc65-46fd-bf37-9a0bbd0e6a29","Type":"ContainerStarted","Data":"ce52b7ba3a640bd7226e072f7ba77c29529ad7cfda173c06dd70ad51ecaa09e7"}
Sep 19 15:52:36.135898 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:36.135862    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cb9nl" event={"ID":"1a27766f-fc65-46fd-bf37-9a0bbd0e6a29","Type":"ContainerStarted","Data":"66b4488600c0a8e16cf0141eba8a348b171343a22706e16d7940d572cea4c525"}
Sep 19 15:52:36.136413 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:36.135998    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cb9nl"
Sep 19 15:52:36.157451 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:36.157407    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cb9nl" podStartSLOduration=2.157390878 podStartE2EDuration="2.157390878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:52:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:52:36.155093353 +0000 UTC m=+2419.318508392" watchObservedRunningTime="2026-09-19 15:52:36.157390878 +0000 UTC m=+2419.320805917"
Sep 19 15:52:47.144173 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:47.144083    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cb9nl"
Sep 19 15:52:54.429367 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:54.429335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:52:54.643434 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:52:54.643401    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:53:02.837366 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:02.837321    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:53:08.584416 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:08.584386    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:53:18.132021 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:18.131989    2562 scope.go:117] "RemoveContainer" containerID="185efcfbbc905075680d1e2b18cd42117462406a8600c30915af2419e89242bc"
Sep 19 15:53:18.140291 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:18.140270    2562 scope.go:117] "RemoveContainer" containerID="250541666a82b9f72e4f0cb63e6286859fdd591349267a08806b9d021191fbed"
Sep 19 15:53:29.069642 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:29.069615    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:53:31.538665 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:31.538631    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:53:36.131716 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.131682    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"]
Sep 19 15:53:36.135356 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.135340    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.137520 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.137495    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-452b12f1-kserve-self-signed-certs\""
Sep 19 15:53:36.145097 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.145072    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"]
Sep 19 15:53:36.166922 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.166897    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:53:36.179175 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.179156    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-tmp-dir\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.179175 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.179183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-model-cache\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.179362 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.179233    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/545153c5-8923-4241-97a5-c1d1ec6193f1-tls-certs\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.179362 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.179318    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-home\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.179445 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.179365    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82qkl\" (UniqueName: \"kubernetes.io/projected/545153c5-8923-4241-97a5-c1d1ec6193f1-kube-api-access-82qkl\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.179445 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.179388    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-dshm\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.280486 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.280464    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/545153c5-8923-4241-97a5-c1d1ec6193f1-tls-certs\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.280581 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.280511    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-home\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.280581 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.280539    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82qkl\" (UniqueName: \"kubernetes.io/projected/545153c5-8923-4241-97a5-c1d1ec6193f1-kube-api-access-82qkl\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.280581 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.280568    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-dshm\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.280740 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.280604    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-tmp-dir\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.280740 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.280621    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-model-cache\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.280972 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.280955    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-model-cache\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.281038 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.281007    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-tmp-dir\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.281102 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.281062    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-home\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.282990 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.282967    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-dshm\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.283077 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.283069    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/545153c5-8923-4241-97a5-c1d1ec6193f1-tls-certs\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.288000 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.287978    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82qkl\" (UniqueName: \"kubernetes.io/projected/545153c5-8923-4241-97a5-c1d1ec6193f1-kube-api-access-82qkl\") pod \"e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") " pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.446061 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.445980    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:36.717460 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:36.717432    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"]
Sep 19 15:53:36.719981 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:53:36.719950    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod545153c5_8923_4241_97a5_c1d1ec6193f1.slice/crio-473cabb1ae3b79c61628e5634479b7e5223996dfe6be5dd1c58b01119c2c7520 WatchSource:0}: Error finding container 473cabb1ae3b79c61628e5634479b7e5223996dfe6be5dd1c58b01119c2c7520: Status 404 returned error can't find the container with id 473cabb1ae3b79c61628e5634479b7e5223996dfe6be5dd1c58b01119c2c7520
Sep 19 15:53:37.451688 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:37.451658    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv" event={"ID":"545153c5-8923-4241-97a5-c1d1ec6193f1","Type":"ContainerStarted","Data":"0063ee107edeb7ec897f4de518b4fe56fc6528a2e0742282cd011fffe8bc219c"}
Sep 19 15:53:37.451688 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:37.451693    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv" event={"ID":"545153c5-8923-4241-97a5-c1d1ec6193f1","Type":"ContainerStarted","Data":"473cabb1ae3b79c61628e5634479b7e5223996dfe6be5dd1c58b01119c2c7520"}
Sep 19 15:53:37.467644 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:37.467598    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv" podStartSLOduration=1.467583827 podStartE2EDuration="1.467583827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:53:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:53:37.465811139 +0000 UTC m=+2480.629226179" watchObservedRunningTime="2026-09-19 15:53:37.467583827 +0000 UTC m=+2480.630998866"
Sep 19 15:53:38.578147 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:38.578115    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:53:46.446637 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:46.446601    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:46.447058 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:46.446827    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:46.465290 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:46.465263    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:46.516700 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:46.516669    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:53:55.503052 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:55.503014    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:53:57.361599 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:57.361559    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:53:57.513914 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:57.513883    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"]
Sep 19 15:53:57.534259 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:53:57.534232    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:54:05.638766 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:05.638731    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:54:11.360761 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:11.360723    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:54:12.533866 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:12.533808    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv" podUID="545153c5-8923-4241-97a5-c1d1ec6193f1" containerName="main" containerID="cri-o://0063ee107edeb7ec897f4de518b4fe56fc6528a2e0742282cd011fffe8bc219c" gracePeriod=45
Sep 19 15:54:12.774352 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:12.774325    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:54:12.908554 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:12.908475    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-dshm\") pod \"545153c5-8923-4241-97a5-c1d1ec6193f1\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") "
Sep 19 15:54:12.908554 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:12.908511    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-tmp-dir\") pod \"545153c5-8923-4241-97a5-c1d1ec6193f1\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") "
Sep 19 15:54:12.908554 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:12.908552    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/545153c5-8923-4241-97a5-c1d1ec6193f1-tls-certs\") pod \"545153c5-8923-4241-97a5-c1d1ec6193f1\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") "
Sep 19 15:54:12.908823 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:12.908662    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-home\") pod \"545153c5-8923-4241-97a5-c1d1ec6193f1\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") "
Sep 19 15:54:12.908823 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:12.908709    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-model-cache\") pod \"545153c5-8923-4241-97a5-c1d1ec6193f1\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") "
Sep 19 15:54:12.908823 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:12.908756    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82qkl\" (UniqueName: \"kubernetes.io/projected/545153c5-8923-4241-97a5-c1d1ec6193f1-kube-api-access-82qkl\") pod \"545153c5-8923-4241-97a5-c1d1ec6193f1\" (UID: \"545153c5-8923-4241-97a5-c1d1ec6193f1\") "
Sep 19 15:54:12.908966 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:12.908749    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "545153c5-8923-4241-97a5-c1d1ec6193f1" (UID: "545153c5-8923-4241-97a5-c1d1ec6193f1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:54:12.908966 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:12.908934    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-model-cache" (OuterVolumeSpecName: "model-cache") pod "545153c5-8923-4241-97a5-c1d1ec6193f1" (UID: "545153c5-8923-4241-97a5-c1d1ec6193f1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:54:12.908966 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:12.908950    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-home" (OuterVolumeSpecName: "home") pod "545153c5-8923-4241-97a5-c1d1ec6193f1" (UID: "545153c5-8923-4241-97a5-c1d1ec6193f1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:54:12.909172 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:12.909124    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-home\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:54:12.909305 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:12.909231    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-model-cache\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:54:12.909350 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:12.909343    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-tmp-dir\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:54:12.910801 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:12.910777    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-dshm" (OuterVolumeSpecName: "dshm") pod "545153c5-8923-4241-97a5-c1d1ec6193f1" (UID: "545153c5-8923-4241-97a5-c1d1ec6193f1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:54:12.910917 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:12.910859    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/545153c5-8923-4241-97a5-c1d1ec6193f1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "545153c5-8923-4241-97a5-c1d1ec6193f1" (UID: "545153c5-8923-4241-97a5-c1d1ec6193f1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:54:12.910917 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:12.910904    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/545153c5-8923-4241-97a5-c1d1ec6193f1-kube-api-access-82qkl" (OuterVolumeSpecName: "kube-api-access-82qkl") pod "545153c5-8923-4241-97a5-c1d1ec6193f1" (UID: "545153c5-8923-4241-97a5-c1d1ec6193f1"). InnerVolumeSpecName "kube-api-access-82qkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:54:13.010249 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:13.010189    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82qkl\" (UniqueName: \"kubernetes.io/projected/545153c5-8923-4241-97a5-c1d1ec6193f1-kube-api-access-82qkl\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:54:13.010249 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:13.010245    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/545153c5-8923-4241-97a5-c1d1ec6193f1-dshm\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:54:13.010249 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:13.010258    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/545153c5-8923-4241-97a5-c1d1ec6193f1-tls-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\""
Sep 19 15:54:13.648570 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:13.648472    2562 generic.go:356] "Generic (PLEG): container finished" podID="545153c5-8923-4241-97a5-c1d1ec6193f1" containerID="0063ee107edeb7ec897f4de518b4fe56fc6528a2e0742282cd011fffe8bc219c" exitCode=0
Sep 19 15:54:13.648570 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:13.648520    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"
Sep 19 15:54:13.648570 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:13.648542    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv" event={"ID":"545153c5-8923-4241-97a5-c1d1ec6193f1","Type":"ContainerDied","Data":"0063ee107edeb7ec897f4de518b4fe56fc6528a2e0742282cd011fffe8bc219c"}
Sep 19 15:54:13.649179 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:13.648574    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv" event={"ID":"545153c5-8923-4241-97a5-c1d1ec6193f1","Type":"ContainerDied","Data":"473cabb1ae3b79c61628e5634479b7e5223996dfe6be5dd1c58b01119c2c7520"}
Sep 19 15:54:13.649179 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:13.648591    2562 scope.go:117] "RemoveContainer" containerID="0063ee107edeb7ec897f4de518b4fe56fc6528a2e0742282cd011fffe8bc219c"
Sep 19 15:54:13.657555 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:13.657535    2562 scope.go:117] "RemoveContainer" containerID="0063ee107edeb7ec897f4de518b4fe56fc6528a2e0742282cd011fffe8bc219c"
Sep 19 15:54:13.657868 ip-10-0-132-152 kubenswrapper[2562]: E0919 15:54:13.657850    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0063ee107edeb7ec897f4de518b4fe56fc6528a2e0742282cd011fffe8bc219c\": container with ID starting with 0063ee107edeb7ec897f4de518b4fe56fc6528a2e0742282cd011fffe8bc219c not found: ID does not exist" containerID="0063ee107edeb7ec897f4de518b4fe56fc6528a2e0742282cd011fffe8bc219c"
Sep 19 15:54:13.657931 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:13.657878    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0063ee107edeb7ec897f4de518b4fe56fc6528a2e0742282cd011fffe8bc219c"} err="failed to get container status \"0063ee107edeb7ec897f4de518b4fe56fc6528a2e0742282cd011fffe8bc219c\": rpc error: code = NotFound desc = could not find container \"0063ee107edeb7ec897f4de518b4fe56fc6528a2e0742282cd011fffe8bc219c\": container with ID starting with 0063ee107edeb7ec897f4de518b4fe56fc6528a2e0742282cd011fffe8bc219c not found: ID does not exist"
Sep 19 15:54:13.664567 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:13.664439    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"]
Sep 19 15:54:13.666141 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:13.666123    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-452b12f1-kserve-7789f8f647-2pgxv"]
Sep 19 15:54:15.344422 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:15.344391    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="545153c5-8923-4241-97a5-c1d1ec6193f1" path="/var/lib/kubelet/pods/545153c5-8923-4241-97a5-c1d1ec6193f1/volumes"
Sep 19 15:54:18.166216 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:18.166172    2562 scope.go:117] "RemoveContainer" containerID="bb3900311225b4f0bb1f0840ad57829830bc3e56b3f725279a6eef44fc376174"
Sep 19 15:54:18.238112 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:18.238066    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:54:25.967456 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:25.967418    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:54:32.740396 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:32.740361    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:54:38.849550 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:38.849517    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:54:45.653147 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:45.653109    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6m25c"]
Sep 19 15:54:54.216791 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:54.216765    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-hssgm_81afd963-013e-4e1c-b01e-fa8bfb068544/manager/0.log"
Sep 19 15:54:54.568121 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:54.568098    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6h2sw_246a63da-6788-4466-837b-d2e77bcbb139/server/0.log"
Sep 19 15:54:54.679388 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:54.679361    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hht6k_b1dff80a-36ed-4a22-b6f4-38191af17d33/manager/0.log"
Sep 19 15:54:54.792773 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:54.792750    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d8c7f66c-9clj9_c0d18380-844e-411f-b680-61005fce5889/copy-manifests/0.log"
Sep 19 15:54:54.799357 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:54.799329    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d8c7f66c-9clj9_c0d18380-844e-411f-b680-61005fce5889/manager/0.log"
Sep 19 15:54:55.738738 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:55.738707    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29830545-krcdm_bb7c7934-6213-49e6-96a3-e35450fae73b/cleanup/0.log"
Sep 19 15:54:57.036463 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:57.036437    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-cb9nl_1a27766f-fc65-46fd-bf37-9a0bbd0e6a29/manager/0.log"
Sep 19 15:54:57.142485 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:57.142463    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-6m25c_b4b75dd2-61ed-4f17-a74e-e6d7df4faa89/limitador/0.log"
Sep 19 15:54:57.607469 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:57.607445    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs_8f011b6f-baee-43f6-97a7-fe3dd585a9b3/istio-proxy/0.log"
Sep 19 15:54:57.638216 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:57.638164    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:54:58.060763 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:58.060734    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4xx67_b0929386-81b6-467e-8381-700e2a4da83b/istio-proxy/1.log"
Sep 19 15:54:58.707939 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:58.707909    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h_8ad2c103-c6f8-45d3-9694-c7d33661ae99/main/0.log"
Sep 19 15:54:58.928891 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:58.928867    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h_f5bfbba7-0224-4e23-b50d-dc405b0573d4/main/0.log"
Sep 19 15:54:59.036260 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:54:59.036235    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-pkthv_6699db00-e0f5-4585-9914-c4b63e210134/main/0.log"
Sep 19 15:55:06.239234 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:06.239179    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-hssgm_81afd963-013e-4e1c-b01e-fa8bfb068544/manager/0.log"
Sep 19 15:55:06.592931 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:06.592904    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6h2sw_246a63da-6788-4466-837b-d2e77bcbb139/server/0.log"
Sep 19 15:55:06.705124 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:06.705094    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hht6k_b1dff80a-36ed-4a22-b6f4-38191af17d33/manager/0.log"
Sep 19 15:55:06.817393 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:06.817374    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d8c7f66c-9clj9_c0d18380-844e-411f-b680-61005fce5889/copy-manifests/0.log"
Sep 19 15:55:06.823598 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:06.823576    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d8c7f66c-9clj9_c0d18380-844e-411f-b680-61005fce5889/manager/0.log"
Sep 19 15:55:07.744286 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:07.744261    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29830545-krcdm_bb7c7934-6213-49e6-96a3-e35450fae73b/cleanup/0.log"
Sep 19 15:55:09.067003 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:09.066971    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-cb9nl_1a27766f-fc65-46fd-bf37-9a0bbd0e6a29/manager/0.log"
Sep 19 15:55:09.201612 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:09.201586    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-6m25c_b4b75dd2-61ed-4f17-a74e-e6d7df4faa89/limitador/0.log"
Sep 19 15:55:09.657251 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:09.657226    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs_8f011b6f-baee-43f6-97a7-fe3dd585a9b3/istio-proxy/0.log"
Sep 19 15:55:10.115691 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:10.115666    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4xx67_b0929386-81b6-467e-8381-700e2a4da83b/istio-proxy/1.log"
Sep 19 15:55:10.781827 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:10.781793    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-z488h_8ad2c103-c6f8-45d3-9694-c7d33661ae99/main/0.log"
Sep 19 15:55:10.992094 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:10.992070    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-w2x8h_f5bfbba7-0224-4e23-b50d-dc405b0573d4/main/0.log"
Sep 19 15:55:11.108112 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:11.108082    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-pkthv_6699db00-e0f5-4585-9914-c4b63e210134/main/0.log"
Sep 19 15:55:18.189184 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:18.189151    2562 scope.go:117] "RemoveContainer" containerID="7adbb0db83a1a143c42cffa997d3009484f6ba2a558fb130504b0a33f2106115"
Sep 19 15:55:18.197665 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:18.197646    2562 scope.go:117] "RemoveContainer" containerID="e22f0649a9a83d45b3f94d37c0688b9b1a5e5ddf5b98e99b2095936359a40777"
Sep 19 15:55:29.492569 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.492537    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-79whr/must-gather-pz55t"]
Sep 19 15:55:29.493024 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.492931    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="545153c5-8923-4241-97a5-c1d1ec6193f1" containerName="main"
Sep 19 15:55:29.493024 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.492943    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="545153c5-8923-4241-97a5-c1d1ec6193f1" containerName="main"
Sep 19 15:55:29.493024 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.493002    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="545153c5-8923-4241-97a5-c1d1ec6193f1" containerName="main"
Sep 19 15:55:29.496164 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.496148    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-79whr/must-gather-pz55t"
Sep 19 15:55:29.498948 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.498926    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-79whr\"/\"default-dockercfg-dqvw7\""
Sep 19 15:55:29.499056 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.499001    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-79whr\"/\"kube-root-ca.crt\""
Sep 19 15:55:29.499862 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.499843    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-79whr\"/\"openshift-service-ca.crt\""
Sep 19 15:55:29.509697 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.509677    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-79whr/must-gather-pz55t"]
Sep 19 15:55:29.517886 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.517866    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:55:29.583034 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.583013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcffc\" (UniqueName: \"kubernetes.io/projected/1fc4a80d-f217-4ff4-8948-336965db865a-kube-api-access-tcffc\") pod \"must-gather-pz55t\" (UID: \"1fc4a80d-f217-4ff4-8948-336965db865a\") " pod="openshift-must-gather-79whr/must-gather-pz55t"
Sep 19 15:55:29.583129 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.583078    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1fc4a80d-f217-4ff4-8948-336965db865a-must-gather-output\") pod \"must-gather-pz55t\" (UID: \"1fc4a80d-f217-4ff4-8948-336965db865a\") " pod="openshift-must-gather-79whr/must-gather-pz55t"
Sep 19 15:55:29.604016 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.603988    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log" limit=1024
Sep 19 15:55:29.684122 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.684100    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcffc\" (UniqueName: \"kubernetes.io/projected/1fc4a80d-f217-4ff4-8948-336965db865a-kube-api-access-tcffc\") pod \"must-gather-pz55t\" (UID: \"1fc4a80d-f217-4ff4-8948-336965db865a\") " pod="openshift-must-gather-79whr/must-gather-pz55t"
Sep 19 15:55:29.684241 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.684154    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1fc4a80d-f217-4ff4-8948-336965db865a-must-gather-output\") pod \"must-gather-pz55t\" (UID: \"1fc4a80d-f217-4ff4-8948-336965db865a\") " pod="openshift-must-gather-79whr/must-gather-pz55t"
Sep 19 15:55:29.684436 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.684422    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1fc4a80d-f217-4ff4-8948-336965db865a-must-gather-output\") pod \"must-gather-pz55t\" (UID: \"1fc4a80d-f217-4ff4-8948-336965db865a\") " pod="openshift-must-gather-79whr/must-gather-pz55t"
Sep 19 15:55:29.693073 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.693056    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcffc\" (UniqueName: \"kubernetes.io/projected/1fc4a80d-f217-4ff4-8948-336965db865a-kube-api-access-tcffc\") pod \"must-gather-pz55t\" (UID: \"1fc4a80d-f217-4ff4-8948-336965db865a\") " pod="openshift-must-gather-79whr/must-gather-pz55t"
Sep 19 15:55:29.805710 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:29.805692    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-79whr/must-gather-pz55t"
Sep 19 15:55:30.074653 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:30.074629    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-79whr/must-gather-pz55t"]
Sep 19 15:55:30.077136 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:55:30.077110    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fc4a80d_f217_4ff4_8948_336965db865a.slice/crio-1b20dc8f91cbe3325b3b81d1208f9c3a1362d2c3fd47e0196b2e231aabd784d1 WatchSource:0}: Error finding container 1b20dc8f91cbe3325b3b81d1208f9c3a1362d2c3fd47e0196b2e231aabd784d1: Status 404 returned error can't find the container with id 1b20dc8f91cbe3325b3b81d1208f9c3a1362d2c3fd47e0196b2e231aabd784d1
Sep 19 15:55:30.079074 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:30.079056    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 15:55:31.038255 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:31.038219    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79whr/must-gather-pz55t" event={"ID":"1fc4a80d-f217-4ff4-8948-336965db865a","Type":"ContainerStarted","Data":"1b20dc8f91cbe3325b3b81d1208f9c3a1362d2c3fd47e0196b2e231aabd784d1"}
Sep 19 15:55:32.047775 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:32.047736    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79whr/must-gather-pz55t" event={"ID":"1fc4a80d-f217-4ff4-8948-336965db865a","Type":"ContainerStarted","Data":"9e14a93b45aacf71d85c0024956b0257e90e5663e7664df7263a1d1e2193ed7f"}
Sep 19 15:55:32.048370 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:32.048340    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79whr/must-gather-pz55t" event={"ID":"1fc4a80d-f217-4ff4-8948-336965db865a","Type":"ContainerStarted","Data":"6139c52909d936f45230aea10be2645a354a296760790082e3000a4bacbd1cf3"}
Sep 19 15:55:32.065752 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:32.065694    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-79whr/must-gather-pz55t" podStartSLOduration=2.084683122 podStartE2EDuration="3.065673035s" totalImagesPullingTime="980.989913ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:55:32.062984501 +0000 UTC m=+2595.226399542" watchObservedRunningTime="2026-09-19 15:55:32.065673035 +0000 UTC m=+2595.229088076"
Sep 19 15:55:32.607648 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:32.607616    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gqhmn_b24d686f-e9ed-4920-af05-39519e7c35a0/global-pull-secret-syncer/0.log"
Sep 19 15:55:32.761364 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:32.761334    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-55xl9_64d9e6c6-4c5e-4dbf-b313-48309f1fc05f/konnectivity-agent/0.log"
Sep 19 15:55:32.858179 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:32.858090    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-152.ec2.internal_c95e12dfda0431cef9884d54113acd82/haproxy/0.log"
Sep 19 15:55:37.295577 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:37.295540    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-cb9nl_1a27766f-fc65-46fd-bf37-9a0bbd0e6a29/manager/0.log"
Sep 19 15:55:37.317579 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:37.317499    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-6m25c_b4b75dd2-61ed-4f17-a74e-e6d7df4faa89/limitador/0.log"
Sep 19 15:55:39.300228 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:39.300169    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5c6b474b65-b8v8r_396db92b-0d94-47e8-a410-d93b0d36c994/metrics-server/0.log"
Sep 19 15:55:39.324371 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:39.324284    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-j6f45_93247531-532a-4d98-bb85-9b6a44dfbbf7/monitoring-plugin/0.log"
Sep 19 15:55:39.420337 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:39.420314    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c4b8p_42b4977e-7575-4b78-8494-a8380a00dc70/node-exporter/0.log"
Sep 19 15:55:39.447994 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:39.447945    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c4b8p_42b4977e-7575-4b78-8494-a8380a00dc70/kube-rbac-proxy/0.log"
Sep 19 15:55:39.473046 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:39.473021    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c4b8p_42b4977e-7575-4b78-8494-a8380a00dc70/init-textfile/0.log"
Sep 19 15:55:39.586879 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:39.586834    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-4jl5z_eeef2cba-8699-4b27-8391-05dbab24bf55/kube-rbac-proxy-main/0.log"
Sep 19 15:55:39.608304 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:39.608265    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-4jl5z_eeef2cba-8699-4b27-8391-05dbab24bf55/kube-rbac-proxy-self/0.log"
Sep 19 15:55:39.628785 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:39.628756    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-4jl5z_eeef2cba-8699-4b27-8391-05dbab24bf55/openshift-state-metrics/0.log"
Sep 19 15:55:39.666146 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:39.666076    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9606391d-496b-4595-bcc5-b8c826a45c1a/prometheus/0.log"
Sep 19 15:55:39.684496 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:39.684465    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9606391d-496b-4595-bcc5-b8c826a45c1a/config-reloader/0.log"
Sep 19 15:55:39.713447 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:39.713418    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9606391d-496b-4595-bcc5-b8c826a45c1a/thanos-sidecar/0.log"
Sep 19 15:55:39.735835 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:39.735801    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9606391d-496b-4595-bcc5-b8c826a45c1a/kube-rbac-proxy-web/0.log"
Sep 19 15:55:39.756700 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:39.756672    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9606391d-496b-4595-bcc5-b8c826a45c1a/kube-rbac-proxy/0.log"
Sep 19 15:55:39.776163 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:39.776135    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9606391d-496b-4595-bcc5-b8c826a45c1a/kube-rbac-proxy-thanos/0.log"
Sep 19 15:55:39.798764 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:39.798731    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9606391d-496b-4595-bcc5-b8c826a45c1a/init-config-reloader/0.log"
Sep 19 15:55:39.871554 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:39.871523    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-4blwd_7402a1b4-c269-40aa-af9c-c31b7682d427/prometheus-operator-admission-webhook/0.log"
Sep 19 15:55:40.001378 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:40.001348    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64d7d46d-d4299_c2ef1642-31c5-4f40-8944-5a286a50ef27/thanos-query/0.log"
Sep 19 15:55:40.022670 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:40.022606    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64d7d46d-d4299_c2ef1642-31c5-4f40-8944-5a286a50ef27/kube-rbac-proxy-web/0.log"
Sep 19 15:55:40.048919 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:40.048877    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64d7d46d-d4299_c2ef1642-31c5-4f40-8944-5a286a50ef27/kube-rbac-proxy/0.log"
Sep 19 15:55:40.077608 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:40.077567    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64d7d46d-d4299_c2ef1642-31c5-4f40-8944-5a286a50ef27/prom-label-proxy/0.log"
Sep 19 15:55:40.099313 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:40.099283    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64d7d46d-d4299_c2ef1642-31c5-4f40-8944-5a286a50ef27/kube-rbac-proxy-rules/0.log"
Sep 19 15:55:40.122956 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:40.122922    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64d7d46d-d4299_c2ef1642-31c5-4f40-8944-5a286a50ef27/kube-rbac-proxy-metrics/0.log"
Sep 19 15:55:42.755738 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:42.755711    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69dc668f4d-hbwxl_09d3a394-7a69-47ff-966a-a0d1018c171f/console/0.log"
Sep 19 15:55:42.787722 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:42.787693    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-vp9qx_8ffc9247-0f31-4479-8fe3-fedd3e344726/download-server/0.log"
Sep 19 15:55:42.824323 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:42.824285    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"]
Sep 19 15:55:42.830243 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:42.830216    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:42.837153 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:42.837123    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"]
Sep 19 15:55:42.944688 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:42.944645    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52hbl\" (UniqueName: \"kubernetes.io/projected/9c320411-9a52-4b54-89ca-c7536475a6d7-kube-api-access-52hbl\") pod \"perf-node-gather-daemonset-9jf5c\" (UID: \"9c320411-9a52-4b54-89ca-c7536475a6d7\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:42.944880 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:42.944744    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c320411-9a52-4b54-89ca-c7536475a6d7-proc\") pod \"perf-node-gather-daemonset-9jf5c\" (UID: \"9c320411-9a52-4b54-89ca-c7536475a6d7\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:42.944880 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:42.944785    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c320411-9a52-4b54-89ca-c7536475a6d7-sys\") pod \"perf-node-gather-daemonset-9jf5c\" (UID: \"9c320411-9a52-4b54-89ca-c7536475a6d7\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:42.944880 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:42.944809    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c320411-9a52-4b54-89ca-c7536475a6d7-lib-modules\") pod \"perf-node-gather-daemonset-9jf5c\" (UID: \"9c320411-9a52-4b54-89ca-c7536475a6d7\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:42.944880 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:42.944842    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c320411-9a52-4b54-89ca-c7536475a6d7-podres\") pod \"perf-node-gather-daemonset-9jf5c\" (UID: \"9c320411-9a52-4b54-89ca-c7536475a6d7\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:43.046128 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:43.046092    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c320411-9a52-4b54-89ca-c7536475a6d7-proc\") pod \"perf-node-gather-daemonset-9jf5c\" (UID: \"9c320411-9a52-4b54-89ca-c7536475a6d7\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:43.046350 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:43.046141    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c320411-9a52-4b54-89ca-c7536475a6d7-sys\") pod \"perf-node-gather-daemonset-9jf5c\" (UID: \"9c320411-9a52-4b54-89ca-c7536475a6d7\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:43.046350 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:43.046175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c320411-9a52-4b54-89ca-c7536475a6d7-lib-modules\") pod \"perf-node-gather-daemonset-9jf5c\" (UID: \"9c320411-9a52-4b54-89ca-c7536475a6d7\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:43.046350 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:43.046225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c320411-9a52-4b54-89ca-c7536475a6d7-podres\") pod \"perf-node-gather-daemonset-9jf5c\" (UID: \"9c320411-9a52-4b54-89ca-c7536475a6d7\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:43.046350 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:43.046246    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c320411-9a52-4b54-89ca-c7536475a6d7-proc\") pod \"perf-node-gather-daemonset-9jf5c\" (UID: \"9c320411-9a52-4b54-89ca-c7536475a6d7\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:43.046350 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:43.046307    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c320411-9a52-4b54-89ca-c7536475a6d7-sys\") pod \"perf-node-gather-daemonset-9jf5c\" (UID: \"9c320411-9a52-4b54-89ca-c7536475a6d7\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:43.046587 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:43.046350    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c320411-9a52-4b54-89ca-c7536475a6d7-lib-modules\") pod \"perf-node-gather-daemonset-9jf5c\" (UID: \"9c320411-9a52-4b54-89ca-c7536475a6d7\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:43.046587 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:43.046382    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c320411-9a52-4b54-89ca-c7536475a6d7-podres\") pod \"perf-node-gather-daemonset-9jf5c\" (UID: \"9c320411-9a52-4b54-89ca-c7536475a6d7\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:43.046587 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:43.046410    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52hbl\" (UniqueName: \"kubernetes.io/projected/9c320411-9a52-4b54-89ca-c7536475a6d7-kube-api-access-52hbl\") pod \"perf-node-gather-daemonset-9jf5c\" (UID: \"9c320411-9a52-4b54-89ca-c7536475a6d7\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:43.054127 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:43.054101    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52hbl\" (UniqueName: \"kubernetes.io/projected/9c320411-9a52-4b54-89ca-c7536475a6d7-kube-api-access-52hbl\") pod \"perf-node-gather-daemonset-9jf5c\" (UID: \"9c320411-9a52-4b54-89ca-c7536475a6d7\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:43.151123 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:43.150891    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:43.451722 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:43.451685    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"]
Sep 19 15:55:43.459511 ip-10-0-132-152 kubenswrapper[2562]: W0919 15:55:43.459480    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9c320411_9a52_4b54_89ca_c7536475a6d7.slice/crio-6fdd19759f75b9b69b0b5df4e1799bc00dfbe3793574b228258c8da4330edda8 WatchSource:0}: Error finding container 6fdd19759f75b9b69b0b5df4e1799bc00dfbe3793574b228258c8da4330edda8: Status 404 returned error can't find the container with id 6fdd19759f75b9b69b0b5df4e1799bc00dfbe3793574b228258c8da4330edda8
Sep 19 15:55:44.142613 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:44.142574    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c" event={"ID":"9c320411-9a52-4b54-89ca-c7536475a6d7","Type":"ContainerStarted","Data":"444d21e0c5077585368c3909479ccacc3b5d782090f5a1ab16fbbde543992412"}
Sep 19 15:55:44.143077 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:44.142637    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c" event={"ID":"9c320411-9a52-4b54-89ca-c7536475a6d7","Type":"ContainerStarted","Data":"6fdd19759f75b9b69b0b5df4e1799bc00dfbe3793574b228258c8da4330edda8"}
Sep 19 15:55:44.143077 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:44.142669    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:44.161620 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:44.160098    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c" podStartSLOduration=2.160079099 podStartE2EDuration="2.160079099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:55:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:55:44.157432498 +0000 UTC m=+2607.320847539" watchObservedRunningTime="2026-09-19 15:55:44.160079099 +0000 UTC m=+2607.323494142"
Sep 19 15:55:44.698257 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:44.698176    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-45sbs_36959d15-6f58-4b56-9dfc-be887a6f07b1/dns/0.log"
Sep 19 15:55:44.717452 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:44.717424    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-45sbs_36959d15-6f58-4b56-9dfc-be887a6f07b1/kube-rbac-proxy/0.log"
Sep 19 15:55:44.823457 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:44.823428    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4xcgl_c26f271f-4c0a-4303-963e-df1323fa4bec/dns-node-resolver/0.log"
Sep 19 15:55:45.444498 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:45.444448    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xzf7q_6d52154d-1cc7-4041-a644-59b431ba759c/node-ca/0.log"
Sep 19 15:55:46.332305 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:46.332273    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs_8f011b6f-baee-43f6-97a7-fe3dd585a9b3/istio-proxy/0.log"
Sep 19 15:55:47.102626 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:47.102597    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4xx67_b0929386-81b6-467e-8381-700e2a4da83b/istio-proxy/0.log"
Sep 19 15:55:47.106015 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:47.105996    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4xx67_b0929386-81b6-467e-8381-700e2a4da83b/istio-proxy/1.log"
Sep 19 15:55:48.126420 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:48.126377    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zdpzb_821b6690-fc9e-41c5-9cc7-78bd1c526f75/serve-healthcheck-canary/0.log"
Sep 19 15:55:48.788780 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:48.788757    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xwbp8_5c930f9c-df8e-4bcb-bd9a-c056107829a0/kube-rbac-proxy/0.log"
Sep 19 15:55:48.807431 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:48.807399    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xwbp8_5c930f9c-df8e-4bcb-bd9a-c056107829a0/exporter/0.log"
Sep 19 15:55:48.827163 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:48.827139    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xwbp8_5c930f9c-df8e-4bcb-bd9a-c056107829a0/extractor/0.log"
Sep 19 15:55:50.169706 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:50.169675    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-79whr/perf-node-gather-daemonset-9jf5c"
Sep 19 15:55:50.846938 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:50.846910    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-hssgm_81afd963-013e-4e1c-b01e-fa8bfb068544/manager/0.log"
Sep 19 15:55:51.353847 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:51.353817    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6h2sw_246a63da-6788-4466-837b-d2e77bcbb139/server/0.log"
Sep 19 15:55:51.460184 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:51.460139    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hht6k_b1dff80a-36ed-4a22-b6f4-38191af17d33/manager/0.log"
Sep 19 15:55:51.483643 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:51.483611    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d8c7f66c-9clj9_c0d18380-844e-411f-b680-61005fce5889/manager/0.log"
Sep 19 15:55:51.503661 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:51.503633    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d8c7f66c-9clj9_c0d18380-844e-411f-b680-61005fce5889/copy-manifests/0.log"
Sep 19 15:55:52.927354 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:52.927328    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs_8f011b6f-baee-43f6-97a7-fe3dd585a9b3/istio-proxy/0.log"
Sep 19 15:55:53.184269 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:53.184180    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7b79856b6-vd6hb_8cc57920-0038-420f-9adb-dbc73f535e7a/manager/0.log"
Sep 19 15:55:53.678344 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:53.678288    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4xx67_b0929386-81b6-467e-8381-700e2a4da83b/istio-proxy/0.log"
Sep 19 15:55:53.682000 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:53.681960    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4xx67_b0929386-81b6-467e-8381-700e2a4da83b/istio-proxy/1.log"
Sep 19 15:55:55.193619 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:55.193547    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs_8f011b6f-baee-43f6-97a7-fe3dd585a9b3/istio-proxy/0.log"
Sep 19 15:55:55.944722 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:55.944685    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4xx67_b0929386-81b6-467e-8381-700e2a4da83b/istio-proxy/0.log"
Sep 19 15:55:55.948444 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:55.948392    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4xx67_b0929386-81b6-467e-8381-700e2a4da83b/istio-proxy/1.log"
Sep 19 15:55:59.771477 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:59.771448    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hp2zp_1a4bb7a8-7c42-4d58-b35a-7e476a5f107d/kube-multus-additional-cni-plugins/0.log"
Sep 19 15:55:59.790741 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:59.790721    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hp2zp_1a4bb7a8-7c42-4d58-b35a-7e476a5f107d/egress-router-binary-copy/0.log"
Sep 19 15:55:59.809623 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:59.809603    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hp2zp_1a4bb7a8-7c42-4d58-b35a-7e476a5f107d/cni-plugins/0.log"
Sep 19 15:55:59.828693 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:59.828675    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hp2zp_1a4bb7a8-7c42-4d58-b35a-7e476a5f107d/bond-cni-plugin/0.log"
Sep 19 15:55:59.847746 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:59.847728    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hp2zp_1a4bb7a8-7c42-4d58-b35a-7e476a5f107d/routeoverride-cni/0.log"
Sep 19 15:55:59.866308 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:59.866288    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hp2zp_1a4bb7a8-7c42-4d58-b35a-7e476a5f107d/whereabouts-cni-bincopy/0.log"
Sep 19 15:55:59.884397 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:55:59.884354    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hp2zp_1a4bb7a8-7c42-4d58-b35a-7e476a5f107d/whereabouts-cni/0.log"
Sep 19 15:56:00.132683 ip-10-0-132-152 kubenswrapper[2562]: I0919 15:56:00.132656    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gwcr6_aa837c9f-9e43-4dec-a8ae-637125174f5d/kube-multus/0.log"