Sep 15 09:13:54.922533 ip-10-0-136-31 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 09:13:55.341557 ip-10-0-136-31 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 09:13:55.341557 ip-10-0-136-31 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 09:13:55.341557 ip-10-0-136-31 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 09:13:55.341557 ip-10-0-136-31 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 09:13:55.341557 ip-10-0-136-31 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 09:13:55.343415 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.343331    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 09:13:55.348288 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348264    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:13:55.348288 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348284    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:13:55.348288 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348288    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:13:55.348288 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348291    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:13:55.348288 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348295    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348298    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348302    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348305    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348307    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348310    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348313    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348315    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348318    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348321    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348323    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348326    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348328    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348331    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348333    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348336    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348339    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348342    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348344    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348347    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:13:55.348487 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348350    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348352    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348355    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348357    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348360    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348362    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348365    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348368    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348373    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348377    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348381    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348384    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348386    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348389    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348392    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348395    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348398    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348400    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348403    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348405    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:13:55.348998 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348408    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348411    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348413    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348415    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348418    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348420    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348423    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348426    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348429    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348431    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348433    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348437    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348440    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348443    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348447    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348450    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348452    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348455    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348457    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348460    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:13:55.349519 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348462    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348465    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348467    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348470    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348472    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348476    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348479    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348482    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348484    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348487    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348489    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348492    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348495    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348497    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348500    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348502    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348505    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348507    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348510    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:13:55.349999 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348514    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348518    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348522    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348525    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348527    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348530    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348534    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348537    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348540    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348543    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348546    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348550    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348553    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348556    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348558    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.348561    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349274    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349282    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349286    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:13:55.350486 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349289    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349292    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349294    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349297    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349300    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349302    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349305    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349307    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349310    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349312    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349315    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349318    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349320    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349324    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349329    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349332    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349335    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349338    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349341    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349343    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:13:55.350946 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349345    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349348    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349351    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349353    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349356    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349358    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349361    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349363    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349366    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349368    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349371    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349373    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349376    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349379    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349381    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349383    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349386    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349388    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349391    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349393    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:13:55.351493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349396    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349399    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349402    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349404    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349406    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349409    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349412    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349417    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349421    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349424    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349427    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349429    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349432    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349434    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349437    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349439    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349442    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349444    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349448    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:13:55.352008 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349451    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349453    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349455    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349458    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349461    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349463    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349466    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349468    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349471    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349473    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349476    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349478    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349482    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349485    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349488    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349491    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349493    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349496    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349499    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:13:55.352482 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349501    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349503    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349509    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349512    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349515    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349517    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349520    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349523    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349526    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349528    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349531    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349533    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349535    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349538    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349540    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349543    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349545    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349551    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349936    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349942    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:13:55.352983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349945    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349947    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349950    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349953    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349956    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349958    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349961    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349965    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349969    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349972    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349975    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349978    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349981    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349983    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349986    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349991    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349993    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349996    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.349999    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:13:55.353485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350002    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350005    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350007    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350010    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350013    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350015    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350018    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350020    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350023    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350025    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350029    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350031    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350034    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350036    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350039    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350041    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350044    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350046    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350049    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350051    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:13:55.353956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350053    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350056    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350058    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350062    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350064    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350066    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350069    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350071    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350075    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350078    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350080    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350082    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350085    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350087    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350091    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350094    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350097    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350100    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350102    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350104    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:13:55.354501 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350107    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350109    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350113    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350115    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350118    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350121    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350123    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350126    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350128    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350130    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350133    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350137    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350139    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350141    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350144    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350147    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350149    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350151    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350154    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350156    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:13:55.354983 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350159    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350162    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350165    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350167    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350170    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350172    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350175    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350177    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350180    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350182    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350184    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350187    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350189    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350191    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350195    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350197    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350223    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350228    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350299    2575 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350332    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 09:13:55.355493 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350341    2575 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350345    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350349    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350353    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350357    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350361    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350364    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350366    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350370    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350373    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350376    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350379    2575 flags.go:64] FLAG: --cgroup-root=""
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350382    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350385    2575 flags.go:64] FLAG: --client-ca-file=""
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350388    2575 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350391    2575 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350396    2575 flags.go:64] FLAG: --cluster-domain=""
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350399    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350402    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350405    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350409    2575 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350413    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350415    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 09:13:55.356004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350419    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350422    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350425    2575 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350429    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350432    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350435    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350438    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350441    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350444    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350447    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350450    2575 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350453    2575 flags.go:64] FLAG: --enable-server="true"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350456    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350459    2575 flags.go:64] FLAG: --event-burst="100"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350463    2575 flags.go:64] FLAG: --event-qps="50"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350466    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350468    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350471    2575 flags.go:64] FLAG: --eviction-hard=""
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350475    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350478    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350481    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350484    2575 flags.go:64] FLAG: --eviction-soft=""
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350486    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350489    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350492    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 09:13:55.356568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350495    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350498    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350501    2575 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350504    2575 flags.go:64] FLAG: --feature-gates=""
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350507    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350510    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350513    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350516    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350519    2575 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350522    2575 flags.go:64] FLAG: --help="false"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350526    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-136-31.ec2.internal"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350529    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350532    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350535    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350538    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350541    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350544    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350546    2575 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350549    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350552    2575 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350554    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350557    2575 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350560    2575 flags.go:64] FLAG: --kube-reserved=""
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350563    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 09:13:55.357182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350565    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350568    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350571    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350573    2575 flags.go:64] FLAG: --lock-file=""
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350578    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350580    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350583    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350588    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350591    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350594    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350597    2575 flags.go:64] FLAG: --logging-format="text"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350599    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350603    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350605    2575 flags.go:64] FLAG: --manifest-url=""
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350608    2575 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350612    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350615    2575 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350618    2575 flags.go:64] FLAG: --max-pods="110"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350621    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350624    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350627    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350630    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350633    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350636    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350638    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 09:13:55.357807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350645    2575 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350648    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350651    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350654    2575 flags.go:64] FLAG: --pod-cidr=""
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350657    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350662    2575 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350664    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350667    2575 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350670    2575 flags.go:64] FLAG: --port="10250"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350673    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350676    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04b8e31ef19ea0cf0"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350680    2575 flags.go:64] FLAG: --qos-reserved=""
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350683    2575 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350686    2575 flags.go:64] FLAG: --register-node="true"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350688    2575 flags.go:64] FLAG: --register-with-taints=""
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350692    2575 flags.go:64] FLAG: --registry-burst="10"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350695    2575 flags.go:64] FLAG: --registry-qps="5"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350698    2575 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350701    2575 flags.go:64] FLAG: --reserved-memory=""
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350704    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350707    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350710    2575 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350713    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350715    2575 flags.go:64] FLAG: --runonce="false"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350718    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 09:13:55.358488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350721    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350724    2575 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350727    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350729    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350732    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350735    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350738    2575 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350740    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350743    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350746    2575 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350748    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350751    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350754    2575 flags.go:64] FLAG: --system-cgroups=""
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350756    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350761    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350764    2575 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350767    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350771    2575 flags.go:64] FLAG: --tls-min-version=""
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350775    2575 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350778    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350781    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350784    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350786    2575 flags.go:64] FLAG: --v="2"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350790    2575 flags.go:64] FLAG: --version="false"
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350795    2575 flags.go:64] FLAG: --vmodule=""
Sep 15 09:13:55.359134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350798    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.350801    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350911    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350915    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350918    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350920    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350925    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350928    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350931    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350934    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350937    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350940    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350944    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350946    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350949    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350952    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350955    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350958    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350960    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:13:55.359765 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350963    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350966    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350968    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350971    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350973    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350976    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350979    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350982    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350985    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350987    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350990    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350992    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350995    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.350999    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351001    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351004    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351006    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351009    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351011    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:13:55.360249 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351014    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351017    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351020    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351022    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351025    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351027    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351030    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351033    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351035    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351038    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351040    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351043    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351046    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351048    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351050    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351053    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351056    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351058    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351061    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351065    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:13:55.360722 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351067    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351070    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351073    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351076    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351078    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351081    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351083    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351086    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351089    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351091    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351094    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351096    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351099    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351103    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351107    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351110    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351112    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351115    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351117    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351120    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:13:55.362860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351122    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351124    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351127    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351129    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351132    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351135    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351137    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351139    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351142    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351144    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351147    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351150    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351153    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351155    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351158    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351160    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351163    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351165    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351168    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351170    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:13:55.363657 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351173    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:13:55.364263 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351176    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:13:55.364263 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.351178    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:13:55.364263 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.351183    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 09:13:55.364263 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.358906    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 09:13:55.364263 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.358921    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 09:13:55.364263 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.359875    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 09:13:55.364263 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.359882    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 09:13:55.364263 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.359958    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:13:55.364263 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.359964    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:13:55.364263 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.359967    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:13:55.364263 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.359970    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:13:55.364263 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.359973    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:13:55.364263 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.359975    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:13:55.364263 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.359978    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:13:55.364263 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.359981    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.359983    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.359986    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.359989    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.359991    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.359994    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.359996    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.359999    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360002    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360004    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360007    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360010    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360012    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360015    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360018    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360021    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360023    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360032    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360035    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:13:55.364683 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360037    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360040    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360043    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360046    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360048    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360051    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360053    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360057    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360061    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360064    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360067    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360069    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360072    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360075    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360077    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360080    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360083    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360085    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360088    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:13:55.365158 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360090    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360093    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360095    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360098    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360100    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360102    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360105    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360107    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360110    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360113    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360115    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360118    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360126    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360128    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360133    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360136    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360140    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360144    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360147    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360150    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:13:55.365644 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360153    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360156    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360159    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360162    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360164    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360167    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360169    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360171    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360174    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360176    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360179    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360181    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360184    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360186    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360189    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360192    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360194    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360197    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360199    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:13:55.366126 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360223    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:13:55.366598 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360227    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:13:55.366598 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360229    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:13:55.366598 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360232    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:13:55.366598 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360235    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:13:55.366598 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360237    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:13:55.366598 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360246    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:13:55.366598 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360249    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:13:55.366598 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360252    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:13:55.366598 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360254    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:13:55.366598 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360257    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:13:55.366598 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360260    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:13:55.366598 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360262    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:13:55.366598 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360265    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:13:55.366598 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360268    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:13:55.366598 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.360273    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360415    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360419    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360422    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360425    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360427    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360430    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360432    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360435    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360437    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360440    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360442    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360445    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360447    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360450    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360453    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360455    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360458    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360461    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360464    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:13:55.366968 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360466    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360469    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360471    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360473    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360482    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360486    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360489    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360492    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360494    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360497    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360499    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360502    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360504    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360506    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360509    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360511    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360513    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360516    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360519    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:13:55.368484 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360521    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360523    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360526    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360528    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360531    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360533    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360536    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360538    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360540    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360543    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360546    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360548    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360551    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360553    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360563    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360565    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360567    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360570    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360578    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360580    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:13:55.368950 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360583    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360585    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360587    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360591    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360595    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360597    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360600    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360602    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360605    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360607    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360610    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360612    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360615    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360617    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360620    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360622    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360625    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360627    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360630    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360632    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:13:55.369460 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360635    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360637    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360640    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360642    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360645    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360648    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360651    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360653    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360656    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360659    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360662    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360670    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360673    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360676    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360679    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360681    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360684    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360686    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360689    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:13:55.369947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360691    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:13:55.370471 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:55.360694    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:13:55.370471 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.360699    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 09:13:55.370471 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.360790    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 09:13:55.370471 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.370033    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 09:13:55.371067 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.371056    2575 server.go:1019] "Starting client certificate rotation"
Sep 15 09:13:55.371311 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.371197    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 09:13:55.371311 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.371267    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 09:13:55.375057 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.375042    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 09:13:55.376432 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.376408    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 09:13:55.391039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.391020    2575 log.go:25] "Validated CRI v1 runtime API"
Sep 15 09:13:55.394341 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.394324    2575 log.go:25] "Validated CRI v1 image API"
Sep 15 09:13:55.395178 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.395166    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 09:13:55.397708 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.397679    2575 fs.go:135] Filesystem UUIDs: map[414869e2-09c9-43ed-baaf-d1e00055ed7b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 db837f53-e855-4d4b-b00f-c8379d2b68db:/dev/nvme0n1p4]
Sep 15 09:13:55.397793 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.397707    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 09:13:55.400835 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.400818    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 09:13:55.403553 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.403436    2575 manager.go:216] Machine: {Timestamp:2026-09-15 09:13:55.402112312 +0000 UTC m=+0.362086525 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3115568 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d7bd6087cdbc2ab4f20933ee887c9 SystemUUID:ec2d7bd6-087c-dbc2-ab4f-20933ee887c9 BootID:8bd2cf5d-d044-42a4-b0d2-b7e247cc751a Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:da:00:dc:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:da:00:dc:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:2a:aa:a3:3a:9e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 09:13:55.403553 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.403546    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 09:13:55.403713 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.403656    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 09:13:55.407254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.407233    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 09:13:55.407394 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.407256    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-31.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 09:13:55.408077 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.408067    2575 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 09:13:55.408150 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.408080    2575 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 09:13:55.408150 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.408087    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 09:13:55.408897 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.408886    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 09:13:55.409972 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.409963    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 09:13:55.413518 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.413507    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 09:13:55.413633 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.413623    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 09:13:55.413666 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.413651    2575 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 09:13:55.413666 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.413661    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 09:13:55.413731 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.413677    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 09:13:55.413731 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.413689    2575 kubelet.go:398] "Adding apiserver pod source"
Sep 15 09:13:55.413731 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.413699    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 09:13:55.414045 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.414032    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 09:13:55.414096 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.414052    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 09:13:55.416386 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.416364    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 09:13:55.419358 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.419343    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 09:13:55.419413 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.419373    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 09:13:55.421299 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.421281    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 09:13:55.421361 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.421304    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 09:13:55.421361 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.421311    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 09:13:55.421361 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.421317    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 09:13:55.421361 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.421326    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 09:13:55.421361 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.421332    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 09:13:55.421361 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.421350    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 09:13:55.421361 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.421356    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 09:13:55.421361 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.421363    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 09:13:55.421568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.421369    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 09:13:55.421568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.421378    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 09:13:55.421568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.421383    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 09:13:55.423320 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.423285    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 09:13:55.423395 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.423379    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 09:13:55.426393 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.426363    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 09:13:55.426462 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.426363    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 09:13:55.426864 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.426845    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4jd2b"
Sep 15 09:13:55.427735 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.427717    2575 server.go:1268] "Started kubelet"
Sep 15 09:13:55.427817 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.427799    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 09:13:55.427867 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.427818    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 09:13:55.427931 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.427917    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 09:13:55.428769 ip-10-0-136-31 systemd[1]: Started Kubernetes Kubelet.
Sep 15 09:13:55.429841 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.429824    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 09:13:55.430844 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.430828    2575 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 09:13:55.432632 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.432613    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 09:13:55.433500 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.433485    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-31.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 09:13:55.434433 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.434419    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4jd2b"
Sep 15 09:13:55.434548 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.433503    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-31.ec2.internal.18d573b20825675f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-31.ec2.internal,UID:ip-10-0-136-31.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-31.ec2.internal,},FirstTimestamp:2026-09-15 09:13:55.427682143 +0000 UTC m=+0.387656357,LastTimestamp:2026-09-15 09:13:55.427682143 +0000 UTC m=+0.387656357,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-31.ec2.internal,}"
Sep 15 09:13:55.437024 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.437010    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 09:13:55.437709 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.437694    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 09:13:55.437959 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.437802    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-31.ec2.internal\" not found"
Sep 15 09:13:55.438361 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.438345    2575 factory.go:55] Registering systemd factory
Sep 15 09:13:55.438422 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.438370    2575 factory.go:223] Registration of the systemd container factory successfully
Sep 15 09:13:55.438548 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.438532    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 09:13:55.438548 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.438543    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 09:13:55.438642 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.438554    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 09:13:55.438642 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.438618    2575 factory.go:153] Registering CRI-O factory
Sep 15 09:13:55.438642 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.438631    2575 factory.go:223] Registration of the crio container factory successfully
Sep 15 09:13:55.438642 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.438636    2575 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 09:13:55.438790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.438645    2575 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 09:13:55.438790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.438677    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 09:13:55.438790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.438691    2575 factory.go:103] Registering Raw factory
Sep 15 09:13:55.438790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.438700    2575 manager.go:1196] Started watching for new ooms in manager
Sep 15 09:13:55.439080 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.439066    2575 manager.go:349] Starting recovery of all containers
Sep 15 09:13:55.440360 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.440334    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 09:13:55.440429 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.440362    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 15 09:13:55.450902 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.450752    2575 manager.go:354] Recovery completed
Sep 15 09:13:55.455388 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.455375    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:13:55.456907 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.456891    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:13:55.456993 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.456924    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:13:55.456993 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.456939    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:13:55.457479 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.457457    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 09:13:55.457479 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.457471    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 09:13:55.457582 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.457490    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 09:13:55.457582 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.457496    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:13:55.458096 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.458084    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:13:55.458165 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.458105    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:13:55.458165 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.458114    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:13:55.458770 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.458756    2575 policy_none.go:49] "None policy: Start"
Sep 15 09:13:55.458821 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.458773    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 09:13:55.458821 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.458783    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 09:13:55.459654 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.459643    2575 policy_none.go:47] "Start"
Sep 15 09:13:55.497813 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.497797    2575 manager.go:337] "Starting Device Plugin manager"
Sep 15 09:13:55.515650 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.497845    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 09:13:55.515650 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.497858    2575 server.go:87] "Starting device plugin registration server"
Sep 15 09:13:55.515650 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.498149    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 09:13:55.515650 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.498163    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 09:13:55.515650 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.498265    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 09:13:55.515650 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.498341    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 09:13:55.515650 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.498349    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 09:13:55.515650 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.498895    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 09:13:55.515650 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.498949    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-31.ec2.internal\" not found"
Sep 15 09:13:55.540103 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.540078    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 09:13:55.541414 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.541389    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 09:13:55.541508 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.541435    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 09:13:55.541508 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.541456    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 09:13:55.541584 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.541535    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 09:13:55.543721 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.543698    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:13:55.598645 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.598574    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:13:55.599433 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.599411    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:13:55.599522 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.599444    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:13:55.599522 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.599454    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:13:55.599522 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.599475    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-31.ec2.internal"
Sep 15 09:13:55.607610 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.607596    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-31.ec2.internal"
Sep 15 09:13:55.607651 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.607617    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-31.ec2.internal\": node \"ip-10-0-136-31.ec2.internal\" not found"
Sep 15 09:13:55.622358 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.622339    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-31.ec2.internal\" not found"
Sep 15 09:13:55.642001 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.641979    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-31.ec2.internal"]
Sep 15 09:13:55.642094 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.642045    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:13:55.643466 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.643451    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:13:55.643516 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.643483    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:13:55.643516 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.643497    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:13:55.644807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.644795    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:13:55.644947 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.644928    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal"
Sep 15 09:13:55.644994 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.644958    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:13:55.645524 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.645508    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:13:55.645524 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.645519    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:13:55.645631 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.645538    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:13:55.645631 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.645551    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:13:55.645631 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.645541    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:13:55.645631 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.645624    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:13:55.646810 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.646797    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-31.ec2.internal"
Sep 15 09:13:55.646846 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.646822    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:13:55.647541 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.647523    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:13:55.647617 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.647552    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:13:55.647617 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.647568    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:13:55.674834 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.674810    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-31.ec2.internal\" not found" node="ip-10-0-136-31.ec2.internal"
Sep 15 09:13:55.679313 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.679298    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-31.ec2.internal\" not found" node="ip-10-0-136-31.ec2.internal"
Sep 15 09:13:55.722458 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.722441    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-31.ec2.internal\" not found"
Sep 15 09:13:55.740853 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.740831    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/526f8918c1338e8bd0bec33e26ffd059-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal\" (UID: \"526f8918c1338e8bd0bec33e26ffd059\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal"
Sep 15 09:13:55.740940 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.740855    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/526f8918c1338e8bd0bec33e26ffd059-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal\" (UID: \"526f8918c1338e8bd0bec33e26ffd059\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal"
Sep 15 09:13:55.740940 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.740877    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ff8a0f9e53340a35ae68e0eed981df6-config\") pod \"kube-apiserver-proxy-ip-10-0-136-31.ec2.internal\" (UID: \"3ff8a0f9e53340a35ae68e0eed981df6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-31.ec2.internal"
Sep 15 09:13:55.823405 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.823387    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-31.ec2.internal\" not found"
Sep 15 09:13:55.841768 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.841730    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/526f8918c1338e8bd0bec33e26ffd059-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal\" (UID: \"526f8918c1338e8bd0bec33e26ffd059\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal"
Sep 15 09:13:55.841847 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.841777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/526f8918c1338e8bd0bec33e26ffd059-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal\" (UID: \"526f8918c1338e8bd0bec33e26ffd059\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal"
Sep 15 09:13:55.841847 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.841817    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/526f8918c1338e8bd0bec33e26ffd059-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal\" (UID: \"526f8918c1338e8bd0bec33e26ffd059\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal"
Sep 15 09:13:55.841847 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.841836    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ff8a0f9e53340a35ae68e0eed981df6-config\") pod \"kube-apiserver-proxy-ip-10-0-136-31.ec2.internal\" (UID: \"3ff8a0f9e53340a35ae68e0eed981df6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-31.ec2.internal"
Sep 15 09:13:55.841847 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.841818    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/526f8918c1338e8bd0bec33e26ffd059-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal\" (UID: \"526f8918c1338e8bd0bec33e26ffd059\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal"
Sep 15 09:13:55.841985 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.841865    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ff8a0f9e53340a35ae68e0eed981df6-config\") pod \"kube-apiserver-proxy-ip-10-0-136-31.ec2.internal\" (UID: \"3ff8a0f9e53340a35ae68e0eed981df6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-31.ec2.internal"
Sep 15 09:13:55.924185 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:55.924139    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-31.ec2.internal\" not found"
Sep 15 09:13:55.977678 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.977659    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal"
Sep 15 09:13:55.982420 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:55.982403    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-31.ec2.internal"
Sep 15 09:13:56.024976 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:56.024956    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-31.ec2.internal\" not found"
Sep 15 09:13:56.125518 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:56.125495    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-31.ec2.internal\" not found"
Sep 15 09:13:56.226013 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:56.225952    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-31.ec2.internal\" not found"
Sep 15 09:13:56.314736 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:56.314715    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:13:56.326555 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:56.326537    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-31.ec2.internal\" not found"
Sep 15 09:13:56.370971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:56.370949    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 09:13:56.371412 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:56.371089    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 09:13:56.371412 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:56.371110    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 09:13:56.427401 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:56.427378    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-31.ec2.internal\" not found"
Sep 15 09:13:56.438111 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:56.438070    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 09:08:56 +0000 UTC" deadline="2028-04-08 01:37:56.209766329 +0000 UTC"
Sep 15 09:13:56.438111 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:56.438107    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13696h23m59.771662644s"
Sep 15 09:13:56.482823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:56.482769    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:13:56.528190 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:56.528168    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-31.ec2.internal\" not found"
Sep 15 09:13:56.628791 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:56.628759    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-31.ec2.internal\" not found"
Sep 15 09:13:56.729283 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:56.729257    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-31.ec2.internal\" not found"
Sep 15 09:13:56.763453 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:56.763420    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff8a0f9e53340a35ae68e0eed981df6.slice/crio-727090ee186d47bf3fa5df86c4ce0e476f43e3d32b72f6044dab6e5db84e45b3 WatchSource:0}: Error finding container 727090ee186d47bf3fa5df86c4ce0e476f43e3d32b72f6044dab6e5db84e45b3: Status 404 returned error can't find the container with id 727090ee186d47bf3fa5df86c4ce0e476f43e3d32b72f6044dab6e5db84e45b3
Sep 15 09:13:56.763766 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:56.763746    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod526f8918c1338e8bd0bec33e26ffd059.slice/crio-f367f1a0f4d29d3e732617d4d07649997badedaa8fd948abbe4008e65e4f2a6e WatchSource:0}: Error finding container f367f1a0f4d29d3e732617d4d07649997badedaa8fd948abbe4008e65e4f2a6e: Status 404 returned error can't find the container with id f367f1a0f4d29d3e732617d4d07649997badedaa8fd948abbe4008e65e4f2a6e
Sep 15 09:13:56.768442 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:56.768426    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:13:56.830138 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:56.830112    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-31.ec2.internal\" not found"
Sep 15 09:13:56.877534 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:56.877518    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:13:58.249257 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.249240    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal"
Sep 15 09:13:58.259880 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.259864    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 09:13:58.260857 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.260845    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-31.ec2.internal"
Sep 15 09:13:58.269405 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.269391    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 09:13:58.725869 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.725825    2575 apiserver.go:52] "Watching apiserver"
Sep 15 09:13:58.738203 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.738174    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 09:13:58.740259 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.740230    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-31.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62","openshift-image-registry/node-ca-hgkhw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal","openshift-multus/network-metrics-daemon-2jd2s","openshift-network-diagnostics/network-check-target-mcckq","openshift-ovn-kubernetes/ovnkube-node-hj965","kube-system/global-pull-secret-syncer-rwg82","openshift-cluster-node-tuning-operator/tuned-r9vwv","openshift-dns/node-resolver-8fznm","openshift-multus/multus-additional-cni-plugins-nx8dj","openshift-multus/multus-x9k52","openshift-network-operator/iptables-alerter-qq5qv","kube-system/konnectivity-agent-8t8sv"]
Sep 15 09:13:58.741966 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.741947    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8fznm"
Sep 15 09:13:58.743050 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.743031    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qq5qv"
Sep 15 09:13:58.744190 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.744170    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hgkhw"
Sep 15 09:13:58.744582 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.744562    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 09:13:58.744876 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.744859    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-42mjt\""
Sep 15 09:13:58.745097 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.745078    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 09:13:58.745344 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.745327    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:13:58.745648 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.745632    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 09:13:58.745881 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.745859    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8t8sv"
Sep 15 09:13:58.745987 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.745964    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nc57z\""
Sep 15 09:13:58.746197 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.746183    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 09:13:58.746492 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.746477    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:13:58.746560 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:58.746527    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd2s" podUID="05297e11-2660-4980-a495-baccd89ae99f"
Sep 15 09:13:58.746718 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.746703    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 09:13:58.746804 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.746723    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p5bs7\""
Sep 15 09:13:58.746970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.746953    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 09:13:58.747441 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.747410    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 09:13:58.747660 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.747644    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:13:58.747733 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.747701    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 09:13:58.747733 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:58.747702    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcckq" podUID="6b4c7605-a586-49d3-9cd7-b0d0502947aa"
Sep 15 09:13:58.749189 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.748507    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5zcnz\""
Sep 15 09:13:58.749189 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.748832    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.749189 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.748855    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 09:13:58.749376 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.749354    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 09:13:58.750241 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.750219    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.752181 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.751736    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:13:58.752181 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.752044    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lf54r\""
Sep 15 09:13:58.752289 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.752195    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 09:13:58.752735 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.752680    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.752833 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.752814    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 09:13:58.753693 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.752879    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bv2fs\""
Sep 15 09:13:58.753693 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.753681    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:13:58.753830 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:58.753735    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwg82" podUID="12d964ec-1ded-49e8-bd7c-18c450406339"
Sep 15 09:13:58.757124 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.756204    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 09:13:58.757124 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.756529    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 09:13:58.757124 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.756814    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 09:13:58.759005 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.757719    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 09:13:58.759005 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.758020    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 09:13:58.759005 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.758026    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 09:13:58.759005 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.758253    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k4xkq\""
Sep 15 09:13:58.759005 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.758259    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 09:13:58.759005 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.758705    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 09:13:58.761588 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.761562    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-systemd-units\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.762664 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.762639    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc865b47-353d-48c1-b3c4-8c51fbc97e44-ovnkube-script-lib\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.762788 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.762697    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3ac0b66-da35-4fc2-964a-e6583ff9a29f-host\") pod \"node-ca-hgkhw\" (UID: \"f3ac0b66-da35-4fc2-964a-e6583ff9a29f\") " pod="openshift-image-registry/node-ca-hgkhw"
Sep 15 09:13:58.762788 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.762720    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f3ac0b66-da35-4fc2-964a-e6583ff9a29f-serviceca\") pod \"node-ca-hgkhw\" (UID: \"f3ac0b66-da35-4fc2-964a-e6583ff9a29f\") " pod="openshift-image-registry/node-ca-hgkhw"
Sep 15 09:13:58.762788 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.762742    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs\") pod \"network-metrics-daemon-2jd2s\" (UID: \"05297e11-2660-4980-a495-baccd89ae99f\") " pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:13:58.762944 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.762793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41dd441e-8166-484d-bc4a-b54748d09062-tmp\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.762944 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.762817    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a62ea6cf-29ca-41e9-854a-a2fa1c13fc53-host-slash\") pod \"iptables-alerter-qq5qv\" (UID: \"a62ea6cf-29ca-41e9-854a-a2fa1c13fc53\") " pod="openshift-network-operator/iptables-alerter-qq5qv"
Sep 15 09:13:58.762944 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.762841    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhnpw\" (UniqueName: \"kubernetes.io/projected/a62ea6cf-29ca-41e9-854a-a2fa1c13fc53-kube-api-access-fhnpw\") pod \"iptables-alerter-qq5qv\" (UID: \"a62ea6cf-29ca-41e9-854a-a2fa1c13fc53\") " pod="openshift-network-operator/iptables-alerter-qq5qv"
Sep 15 09:13:58.762944 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.762863    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-run-netns\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.762944 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.762886    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-run-ovn\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.762944 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.762910    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xj9b\" (UniqueName: \"kubernetes.io/projected/dc865b47-353d-48c1-b3c4-8c51fbc97e44-kube-api-access-7xj9b\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.762944 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.762933    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08-konnectivity-ca\") pod \"konnectivity-agent-8t8sv\" (UID: \"e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08\") " pod="kube-system/konnectivity-agent-8t8sv"
Sep 15 09:13:58.763266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.762953    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41dd441e-8166-484d-bc4a-b54748d09062-etc-tuned\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.763266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.762982    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt4q5\" (UniqueName: \"kubernetes.io/projected/41dd441e-8166-484d-bc4a-b54748d09062-kube-api-access-qt4q5\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.763266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763004    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-kubelet\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.763266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763026    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-run-openvswitch\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.763266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763047    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-log-socket\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.763266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763071    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc865b47-353d-48c1-b3c4-8c51fbc97e44-ovn-node-metrics-cert\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.763266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-var-lib-kubelet\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.763266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763124    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-host\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.763266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763149    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-run-systemd\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.763266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763164    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08-agent-certs\") pod \"konnectivity-agent-8t8sv\" (UID: \"e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08\") " pod="kube-system/konnectivity-agent-8t8sv"
Sep 15 09:13:58.763266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763177    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-modprobe-d\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.763266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763211    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-sysconfig\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.763266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763227    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttsfx\" (UniqueName: \"kubernetes.io/projected/06f3e00e-6b02-4341-af4c-3228fdb5f592-kube-api-access-ttsfx\") pod \"node-resolver-8fznm\" (UID: \"06f3e00e-6b02-4341-af4c-3228fdb5f592\") " pod="openshift-dns/node-resolver-8fznm"
Sep 15 09:13:58.763266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763242    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a62ea6cf-29ca-41e9-854a-a2fa1c13fc53-iptables-alerter-script\") pod \"iptables-alerter-qq5qv\" (UID: \"a62ea6cf-29ca-41e9-854a-a2fa1c13fc53\") " pod="openshift-network-operator/iptables-alerter-qq5qv"
Sep 15 09:13:58.763266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763264    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-var-lib-openvswitch\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.763971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763288    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-etc-openvswitch\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.763971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-cni-netd\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.763971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9clvb\" (UniqueName: \"kubernetes.io/projected/f3ac0b66-da35-4fc2-964a-e6583ff9a29f-kube-api-access-9clvb\") pod \"node-ca-hgkhw\" (UID: \"f3ac0b66-da35-4fc2-964a-e6583ff9a29f\") " pod="openshift-image-registry/node-ca-hgkhw"
Sep 15 09:13:58.763971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763335    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-sysctl-d\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.763971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763352    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06f3e00e-6b02-4341-af4c-3228fdb5f592-tmp-dir\") pod \"node-resolver-8fznm\" (UID: \"06f3e00e-6b02-4341-af4c-3228fdb5f592\") " pod="openshift-dns/node-resolver-8fznm"
Sep 15 09:13:58.763971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763365    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-node-log\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.763971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763380    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc865b47-353d-48c1-b3c4-8c51fbc97e44-ovnkube-config\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.763971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763393    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-run\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.763971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-sys\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.763971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763430    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zxt7\" (UniqueName: \"kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7\") pod \"network-check-target-mcckq\" (UID: \"6b4c7605-a586-49d3-9cd7-b0d0502947aa\") " pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:13:58.763971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763453    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-run-ovn-kubernetes\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.763971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763470    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-cni-bin\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.763971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763484    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc865b47-353d-48c1-b3c4-8c51fbc97e44-env-overrides\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.763971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763502    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdlqp\" (UniqueName: \"kubernetes.io/projected/05297e11-2660-4980-a495-baccd89ae99f-kube-api-access-tdlqp\") pod \"network-metrics-daemon-2jd2s\" (UID: \"05297e11-2660-4980-a495-baccd89ae99f\") " pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:13:58.763971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763519    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-systemd\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.763971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763533    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-slash\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.764696 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763548    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.764696 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763574    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-kubernetes\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.764696 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763597    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-sysctl-conf\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.764696 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763619    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-lib-modules\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.764696 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.763645    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06f3e00e-6b02-4341-af4c-3228fdb5f592-hosts-file\") pod \"node-resolver-8fznm\" (UID: \"06f3e00e-6b02-4341-af4c-3228fdb5f592\") " pod="openshift-dns/node-resolver-8fznm"
Sep 15 09:13:58.765982 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.765139    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.766219 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.766194    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 09:13:58.767024 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.766998    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.767270 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.767150    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 09:13:58.767806 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.767789    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 09:13:58.768007 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.767856    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 09:13:58.768083 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.767933    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 09:13:58.768142 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.767975    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4qx6q\""
Sep 15 09:13:58.768192 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.768169    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 09:13:58.769376 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.769362    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 09:13:58.769648 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.769427    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wc8sf\""
Sep 15 09:13:58.783975 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.783955    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f9dhd"
Sep 15 09:13:58.794151 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.794131    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f9dhd"
Sep 15 09:13:58.850240 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.850216    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 09:13:58.856470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.856412    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal" event={"ID":"526f8918c1338e8bd0bec33e26ffd059","Type":"ContainerStarted","Data":"f367f1a0f4d29d3e732617d4d07649997badedaa8fd948abbe4008e65e4f2a6e"}
Sep 15 09:13:58.857750 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.857715    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-31.ec2.internal" event={"ID":"3ff8a0f9e53340a35ae68e0eed981df6","Type":"ContainerStarted","Data":"727090ee186d47bf3fa5df86c4ce0e476f43e3d32b72f6044dab6e5db84e45b3"}
Sep 15 09:13:58.864832 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.864813    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-etc-openvswitch\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.864933 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.864842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-cni-netd\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.864933 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.864865    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-sysctl-d\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.864933 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.864918    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-cni-netd\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.865073 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.864957    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-etc-openvswitch\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.865073 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.864974    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06f3e00e-6b02-4341-af4c-3228fdb5f592-tmp-dir\") pod \"node-resolver-8fznm\" (UID: \"06f3e00e-6b02-4341-af4c-3228fdb5f592\") " pod="openshift-dns/node-resolver-8fznm"
Sep 15 09:13:58.865073 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.864988    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc865b47-353d-48c1-b3c4-8c51fbc97e44-ovnkube-config\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.865073 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865005    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-sys\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.865073 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865021    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.865073 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865022    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-sysctl-d\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.865454 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865322    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06f3e00e-6b02-4341-af4c-3228fdb5f592-tmp-dir\") pod \"node-resolver-8fznm\" (UID: \"06f3e00e-6b02-4341-af4c-3228fdb5f592\") " pod="openshift-dns/node-resolver-8fznm"
Sep 15 09:13:58.865454 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865443    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc865b47-353d-48c1-b3c4-8c51fbc97e44-ovnkube-config\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.865561 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865500    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-sys\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.865561 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865034    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12d964ec-1ded-49e8-bd7c-18c450406339-dbus\") pod \"global-pull-secret-syncer-rwg82\" (UID: \"12d964ec-1ded-49e8-bd7c-18c450406339\") " pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:13:58.865561 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865531    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret\") pod \"global-pull-secret-syncer-rwg82\" (UID: \"12d964ec-1ded-49e8-bd7c-18c450406339\") " pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:13:58.865561 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865549    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zxt7\" (UniqueName: \"kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7\") pod \"network-check-target-mcckq\" (UID: \"6b4c7605-a586-49d3-9cd7-b0d0502947aa\") " pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:13:58.865790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865563    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-cni-bin\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.865790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865579    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-systemd\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.865790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865596    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6272a978-5c5f-452a-88c0-91affa1d942c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.865790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865610    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-var-lib-cni-multus\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.865790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865627    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-slash\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.865790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865641    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-kubernetes\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.865790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865655    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-lib-modules\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.865790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865669    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-etc-selinux\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.865790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865683    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-run-netns\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.865790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865698    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-multus-conf-dir\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.865790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06f3e00e-6b02-4341-af4c-3228fdb5f592-hosts-file\") pod \"node-resolver-8fznm\" (UID: \"06f3e00e-6b02-4341-af4c-3228fdb5f592\") " pod="openshift-dns/node-resolver-8fznm"
Sep 15 09:13:58.865790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-systemd-units\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.865790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865743    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3ac0b66-da35-4fc2-964a-e6583ff9a29f-host\") pod \"node-ca-hgkhw\" (UID: \"f3ac0b66-da35-4fc2-964a-e6583ff9a29f\") " pod="openshift-image-registry/node-ca-hgkhw"
Sep 15 09:13:58.865790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs\") pod \"network-metrics-daemon-2jd2s\" (UID: \"05297e11-2660-4980-a495-baccd89ae99f\") " pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:13:58.865790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6272a978-5c5f-452a-88c0-91affa1d942c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.866470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhnpw\" (UniqueName: \"kubernetes.io/projected/a62ea6cf-29ca-41e9-854a-a2fa1c13fc53-kube-api-access-fhnpw\") pod \"iptables-alerter-qq5qv\" (UID: \"a62ea6cf-29ca-41e9-854a-a2fa1c13fc53\") " pod="openshift-network-operator/iptables-alerter-qq5qv"
Sep 15 09:13:58.866470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865834    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-run-netns\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.866470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865857    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xj9b\" (UniqueName: \"kubernetes.io/projected/dc865b47-353d-48c1-b3c4-8c51fbc97e44-kube-api-access-7xj9b\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.866470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865873    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08-konnectivity-ca\") pod \"konnectivity-agent-8t8sv\" (UID: \"e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08\") " pod="kube-system/konnectivity-agent-8t8sv"
Sep 15 09:13:58.866470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865886    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41dd441e-8166-484d-bc4a-b54748d09062-etc-tuned\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.866470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt4q5\" (UniqueName: \"kubernetes.io/projected/41dd441e-8166-484d-bc4a-b54748d09062-kube-api-access-qt4q5\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.866470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865927    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-cnibin\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.866470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-device-dir\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.866470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865966    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eac2b225-b6a8-4a94-9206-81a230322573-cni-binary-copy\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.866470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.865988    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-run-systemd\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.866470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866005    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-registration-dir\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.866470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866017    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-lib-modules\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.866470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866201    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-cni-bin\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.866470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866244    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-systemd\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.866470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866301    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-slash\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.866470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866326    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06f3e00e-6b02-4341-af4c-3228fdb5f592-hosts-file\") pod \"node-resolver-8fznm\" (UID: \"06f3e00e-6b02-4341-af4c-3228fdb5f592\") " pod="openshift-dns/node-resolver-8fznm"
Sep 15 09:13:58.866470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866375    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-kubernetes\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.867256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866380    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-systemd-units\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.867256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866395    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-var-lib-cni-bin\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.867256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866427    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3ac0b66-da35-4fc2-964a-e6583ff9a29f-host\") pod \"node-ca-hgkhw\" (UID: \"f3ac0b66-da35-4fc2-964a-e6583ff9a29f\") " pod="openshift-image-registry/node-ca-hgkhw"
Sep 15 09:13:58.867256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866432    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-var-lib-kubelet\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.867256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866514    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-run-systemd\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.867256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866553    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-run-netns\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.867256 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:58.866560    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:13:58.867256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866632    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-etc-kubernetes\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.867256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866635    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 09:13:58.867256 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:58.866675    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs podName:05297e11-2660-4980-a495-baccd89ae99f nodeName:}" failed. No retries permitted until 2026-09-15 09:13:59.366661016 +0000 UTC m=+3.016077087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs") pod "network-metrics-daemon-2jd2s" (UID: "05297e11-2660-4980-a495-baccd89ae99f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:13:58.867256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866665    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12d964ec-1ded-49e8-bd7c-18c450406339-kubelet-config\") pod \"global-pull-secret-syncer-rwg82\" (UID: \"12d964ec-1ded-49e8-bd7c-18c450406339\") " pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:13:58.867256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866780    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttsfx\" (UniqueName: \"kubernetes.io/projected/06f3e00e-6b02-4341-af4c-3228fdb5f592-kube-api-access-ttsfx\") pod \"node-resolver-8fznm\" (UID: \"06f3e00e-6b02-4341-af4c-3228fdb5f592\") " pod="openshift-dns/node-resolver-8fznm"
Sep 15 09:13:58.867256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866795    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a62ea6cf-29ca-41e9-854a-a2fa1c13fc53-iptables-alerter-script\") pod \"iptables-alerter-qq5qv\" (UID: \"a62ea6cf-29ca-41e9-854a-a2fa1c13fc53\") " pod="openshift-network-operator/iptables-alerter-qq5qv"
Sep 15 09:13:58.867256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866809    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-var-lib-openvswitch\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.867256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866823    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9clvb\" (UniqueName: \"kubernetes.io/projected/f3ac0b66-da35-4fc2-964a-e6583ff9a29f-kube-api-access-9clvb\") pod \"node-ca-hgkhw\" (UID: \"f3ac0b66-da35-4fc2-964a-e6583ff9a29f\") " pod="openshift-image-registry/node-ca-hgkhw"
Sep 15 09:13:58.867256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866836    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-run\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.867256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866851    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6272a978-5c5f-452a-88c0-91affa1d942c-system-cni-dir\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.868039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866868    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-node-log\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.868039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866906    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-node-log\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.868039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866925    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-var-lib-openvswitch\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.868039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866932    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-run\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.868039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8br4k\" (UniqueName: \"kubernetes.io/projected/26c3a068-ccd8-48ce-9dd4-d703df179e99-kube-api-access-8br4k\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.868039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866935    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08-konnectivity-ca\") pod \"konnectivity-agent-8t8sv\" (UID: \"e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08\") " pod="kube-system/konnectivity-agent-8t8sv"
Sep 15 09:13:58.868039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866970    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-multus-socket-dir-parent\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.868039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.866988    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-run-ovn-kubernetes\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.868039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867006    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc865b47-353d-48c1-b3c4-8c51fbc97e44-env-overrides\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.868039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867032    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdlqp\" (UniqueName: \"kubernetes.io/projected/05297e11-2660-4980-a495-baccd89ae99f-kube-api-access-tdlqp\") pod \"network-metrics-daemon-2jd2s\" (UID: \"05297e11-2660-4980-a495-baccd89ae99f\") " pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:13:58.868039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867048    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-run-ovn-kubernetes\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.868039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867077    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.868039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867110    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-sysctl-conf\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.868039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867125    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.868039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867142    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-socket-dir\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.868039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867166    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc865b47-353d-48c1-b3c4-8c51fbc97e44-ovnkube-script-lib\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.868039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867186    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f3ac0b66-da35-4fc2-964a-e6583ff9a29f-serviceca\") pod \"node-ca-hgkhw\" (UID: \"f3ac0b66-da35-4fc2-964a-e6583ff9a29f\") " pod="openshift-image-registry/node-ca-hgkhw"
Sep 15 09:13:58.868662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867208    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41dd441e-8166-484d-bc4a-b54748d09062-tmp\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.868662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867229    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6272a978-5c5f-452a-88c0-91affa1d942c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.868662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867251    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6272a978-5c5f-452a-88c0-91affa1d942c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.868662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867271    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-system-cni-dir\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.868662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867292    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-multus-cni-dir\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.868662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867300    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-sysctl-conf\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.868662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867315    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a62ea6cf-29ca-41e9-854a-a2fa1c13fc53-host-slash\") pod \"iptables-alerter-qq5qv\" (UID: \"a62ea6cf-29ca-41e9-854a-a2fa1c13fc53\") " pod="openshift-network-operator/iptables-alerter-qq5qv"
Sep 15 09:13:58.868662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867339    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-run-ovn\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.868662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867360    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-hostroot\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.868662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-kubelet\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.868662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867404    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-run-openvswitch\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.868662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867406    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a62ea6cf-29ca-41e9-854a-a2fa1c13fc53-iptables-alerter-script\") pod \"iptables-alerter-qq5qv\" (UID: \"a62ea6cf-29ca-41e9-854a-a2fa1c13fc53\") " pod="openshift-network-operator/iptables-alerter-qq5qv"
Sep 15 09:13:58.868662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867426    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-log-socket\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.868662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc865b47-353d-48c1-b3c4-8c51fbc97e44-ovn-node-metrics-cert\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.868662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867474    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-host-kubelet\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.868662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867483    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-var-lib-kubelet\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.868662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867509    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-host\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.869277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867425    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc865b47-353d-48c1-b3c4-8c51fbc97e44-env-overrides\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.869277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867540    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-run-ovn\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.869277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867544    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6272a978-5c5f-452a-88c0-91affa1d942c-cnibin\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.869277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867595    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-log-socket\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.869277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867599    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-var-lib-kubelet\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.869277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867603    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-host\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.869277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867635    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a62ea6cf-29ca-41e9-854a-a2fa1c13fc53-host-slash\") pod \"iptables-alerter-qq5qv\" (UID: \"a62ea6cf-29ca-41e9-854a-a2fa1c13fc53\") " pod="openshift-network-operator/iptables-alerter-qq5qv"
Sep 15 09:13:58.869277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867637    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc865b47-353d-48c1-b3c4-8c51fbc97e44-run-openvswitch\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.869277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867665    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-run-k8s-cni-cncf-io\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.869277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867670    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc865b47-353d-48c1-b3c4-8c51fbc97e44-ovnkube-script-lib\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.869277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.867700    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f3ac0b66-da35-4fc2-964a-e6583ff9a29f-serviceca\") pod \"node-ca-hgkhw\" (UID: \"f3ac0b66-da35-4fc2-964a-e6583ff9a29f\") " pod="openshift-image-registry/node-ca-hgkhw"
Sep 15 09:13:58.869277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.868195    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08-agent-certs\") pod \"konnectivity-agent-8t8sv\" (UID: \"e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08\") " pod="kube-system/konnectivity-agent-8t8sv"
Sep 15 09:13:58.869277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.868243    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-modprobe-d\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.869277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.868269    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-sysconfig\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.869277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.868344    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-sys-fs\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.869277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.868365    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-modprobe-d\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.869277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.868368    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j68pv\" (UniqueName: \"kubernetes.io/projected/6272a978-5c5f-452a-88c0-91affa1d942c-kube-api-access-j68pv\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.869961 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.868402    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eac2b225-b6a8-4a94-9206-81a230322573-multus-daemon-config\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.869961 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.868436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-run-multus-certs\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.869961 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.868458    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnnjw\" (UniqueName: \"kubernetes.io/projected/eac2b225-b6a8-4a94-9206-81a230322573-kube-api-access-hnnjw\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.869961 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.868537    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41dd441e-8166-484d-bc4a-b54748d09062-etc-sysconfig\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.872818 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.872533    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41dd441e-8166-484d-bc4a-b54748d09062-tmp\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.872818 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.872745    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41dd441e-8166-484d-bc4a-b54748d09062-etc-tuned\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.873178 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.873157    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc865b47-353d-48c1-b3c4-8c51fbc97e44-ovn-node-metrics-cert\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.873252 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.873197    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08-agent-certs\") pod \"konnectivity-agent-8t8sv\" (UID: \"e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08\") " pod="kube-system/konnectivity-agent-8t8sv"
Sep 15 09:13:58.876207 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:58.876187    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:13:58.876295 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:58.876211    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:13:58.876295 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:58.876225    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5zxt7 for pod openshift-network-diagnostics/network-check-target-mcckq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:13:58.876295 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:58.876280    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7 podName:6b4c7605-a586-49d3-9cd7-b0d0502947aa nodeName:}" failed. No retries permitted until 2026-09-15 09:13:59.376268075 +0000 UTC m=+3.025684145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5zxt7" (UniqueName: "kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7") pod "network-check-target-mcckq" (UID: "6b4c7605-a586-49d3-9cd7-b0d0502947aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:13:58.879628 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.879366    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhnpw\" (UniqueName: \"kubernetes.io/projected/a62ea6cf-29ca-41e9-854a-a2fa1c13fc53-kube-api-access-fhnpw\") pod \"iptables-alerter-qq5qv\" (UID: \"a62ea6cf-29ca-41e9-854a-a2fa1c13fc53\") " pod="openshift-network-operator/iptables-alerter-qq5qv"
Sep 15 09:13:58.879628 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.879585    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9clvb\" (UniqueName: \"kubernetes.io/projected/f3ac0b66-da35-4fc2-964a-e6583ff9a29f-kube-api-access-9clvb\") pod \"node-ca-hgkhw\" (UID: \"f3ac0b66-da35-4fc2-964a-e6583ff9a29f\") " pod="openshift-image-registry/node-ca-hgkhw"
Sep 15 09:13:58.879891 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.879873    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xj9b\" (UniqueName: \"kubernetes.io/projected/dc865b47-353d-48c1-b3c4-8c51fbc97e44-kube-api-access-7xj9b\") pod \"ovnkube-node-hj965\" (UID: \"dc865b47-353d-48c1-b3c4-8c51fbc97e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:58.880491 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.880470    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt4q5\" (UniqueName: \"kubernetes.io/projected/41dd441e-8166-484d-bc4a-b54748d09062-kube-api-access-qt4q5\") pod \"tuned-r9vwv\" (UID: \"41dd441e-8166-484d-bc4a-b54748d09062\") " pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:58.880750 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.880725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttsfx\" (UniqueName: \"kubernetes.io/projected/06f3e00e-6b02-4341-af4c-3228fdb5f592-kube-api-access-ttsfx\") pod \"node-resolver-8fznm\" (UID: \"06f3e00e-6b02-4341-af4c-3228fdb5f592\") " pod="openshift-dns/node-resolver-8fznm"
Sep 15 09:13:58.881657 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.881640    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdlqp\" (UniqueName: \"kubernetes.io/projected/05297e11-2660-4980-a495-baccd89ae99f-kube-api-access-tdlqp\") pod \"network-metrics-daemon-2jd2s\" (UID: \"05297e11-2660-4980-a495-baccd89ae99f\") " pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:13:58.969121 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969092    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-multus-socket-dir-parent\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.969301 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969134    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-socket-dir\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.969301 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969160    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6272a978-5c5f-452a-88c0-91affa1d942c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.969301 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969186    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6272a978-5c5f-452a-88c0-91affa1d942c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.969301 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969209    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-system-cni-dir\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.969301 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969217    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-multus-socket-dir-parent\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.969301 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969229    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-multus-cni-dir\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.969301 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969261    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-hostroot\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.969301 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969280    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-multus-cni-dir\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.969301 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969293    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6272a978-5c5f-452a-88c0-91affa1d942c-cnibin\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.969825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969311    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-socket-dir\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.969825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969326    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-system-cni-dir\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.969825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969316    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-run-k8s-cni-cncf-io\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.969825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969346    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-run-k8s-cni-cncf-io\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.969825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-sys-fs\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.969825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969380    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j68pv\" (UniqueName: \"kubernetes.io/projected/6272a978-5c5f-452a-88c0-91affa1d942c-kube-api-access-j68pv\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.969825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969381    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6272a978-5c5f-452a-88c0-91affa1d942c-cnibin\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.969825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969362    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-hostroot\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.969825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969418    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-sys-fs\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.969825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969445    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eac2b225-b6a8-4a94-9206-81a230322573-multus-daemon-config\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.969825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969467    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-run-multus-certs\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.969825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969491    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnnjw\" (UniqueName: \"kubernetes.io/projected/eac2b225-b6a8-4a94-9206-81a230322573-kube-api-access-hnnjw\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.969825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969519    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.969825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12d964ec-1ded-49e8-bd7c-18c450406339-dbus\") pod \"global-pull-secret-syncer-rwg82\" (UID: \"12d964ec-1ded-49e8-bd7c-18c450406339\") " pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:13:58.969825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969568    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret\") pod \"global-pull-secret-syncer-rwg82\" (UID: \"12d964ec-1ded-49e8-bd7c-18c450406339\") " pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:13:58.969825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6272a978-5c5f-452a-88c0-91affa1d942c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.969825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969632    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-var-lib-cni-multus\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.970734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969658    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-etc-selinux\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.970734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-run-netns\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.970734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-multus-conf-dir\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.970734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969730    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6272a978-5c5f-452a-88c0-91affa1d942c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.970734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969746    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6272a978-5c5f-452a-88c0-91affa1d942c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.970734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969789    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-run-multus-certs\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.970734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969797    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-cnibin\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.970734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969811    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-var-lib-cni-multus\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.970734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969831    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-device-dir\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.970734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969862    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.970734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969862    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eac2b225-b6a8-4a94-9206-81a230322573-cni-binary-copy\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.970734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969862    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-cnibin\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.970734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969872    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6272a978-5c5f-452a-88c0-91affa1d942c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.970734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969887    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-registration-dir\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.970734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-var-lib-cni-bin\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.970734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969919    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-var-lib-kubelet\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.970734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969933    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-etc-kubernetes\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.971699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969954    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12d964ec-1ded-49e8-bd7c-18c450406339-kubelet-config\") pod \"global-pull-secret-syncer-rwg82\" (UID: \"12d964ec-1ded-49e8-bd7c-18c450406339\") " pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:13:58.971699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6272a978-5c5f-452a-88c0-91affa1d942c-system-cni-dir\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.971699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969993    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8br4k\" (UniqueName: \"kubernetes.io/projected/26c3a068-ccd8-48ce-9dd4-d703df179e99-kube-api-access-8br4k\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.971699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.970006    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-run-netns\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.971699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.970019    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6272a978-5c5f-452a-88c0-91affa1d942c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.971699 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:58.970075    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:13:58.971699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.970106    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-var-lib-cni-bin\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.971699 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:58.970129    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret podName:12d964ec-1ded-49e8-bd7c-18c450406339 nodeName:}" failed. No retries permitted until 2026-09-15 09:13:59.47010911 +0000 UTC m=+3.119525195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret") pod "global-pull-secret-syncer-rwg82" (UID: "12d964ec-1ded-49e8-bd7c-18c450406339") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:13:58.971699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.970150    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-device-dir\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.971699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.970212    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-multus-conf-dir\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.971699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.970217    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-etc-kubernetes\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.971699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.970217    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6272a978-5c5f-452a-88c0-91affa1d942c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.971699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.969976    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-etc-selinux\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.971699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.970243    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6272a978-5c5f-452a-88c0-91affa1d942c-system-cni-dir\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.971699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.970254    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/26c3a068-ccd8-48ce-9dd4-d703df179e99-registration-dir\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:58.971699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.970278    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12d964ec-1ded-49e8-bd7c-18c450406339-kubelet-config\") pod \"global-pull-secret-syncer-rwg82\" (UID: \"12d964ec-1ded-49e8-bd7c-18c450406339\") " pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:13:58.971699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.970077    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12d964ec-1ded-49e8-bd7c-18c450406339-dbus\") pod \"global-pull-secret-syncer-rwg82\" (UID: \"12d964ec-1ded-49e8-bd7c-18c450406339\") " pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:13:58.972632 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.970296    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eac2b225-b6a8-4a94-9206-81a230322573-host-var-lib-kubelet\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.972632 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.970597    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eac2b225-b6a8-4a94-9206-81a230322573-multus-daemon-config\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.972632 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.970661    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eac2b225-b6a8-4a94-9206-81a230322573-cni-binary-copy\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.980629 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.980563    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j68pv\" (UniqueName: \"kubernetes.io/projected/6272a978-5c5f-452a-88c0-91affa1d942c-kube-api-access-j68pv\") pod \"multus-additional-cni-plugins-nx8dj\" (UID: \"6272a978-5c5f-452a-88c0-91affa1d942c\") " pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:58.980806 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.980628    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnnjw\" (UniqueName: \"kubernetes.io/projected/eac2b225-b6a8-4a94-9206-81a230322573-kube-api-access-hnnjw\") pod \"multus-x9k52\" (UID: \"eac2b225-b6a8-4a94-9206-81a230322573\") " pod="openshift-multus/multus-x9k52"
Sep 15 09:13:58.980939 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:58.980922    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8br4k\" (UniqueName: \"kubernetes.io/projected/26c3a068-ccd8-48ce-9dd4-d703df179e99-kube-api-access-8br4k\") pod \"aws-ebs-csi-driver-node-cvb62\" (UID: \"26c3a068-ccd8-48ce-9dd4-d703df179e99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:59.057885 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:59.057861    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8fznm"
Sep 15 09:13:59.074717 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:59.074691    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qq5qv"
Sep 15 09:13:59.082303 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:59.082284    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hgkhw"
Sep 15 09:13:59.088927 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:59.088907    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8t8sv"
Sep 15 09:13:59.095600 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:59.095579    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r9vwv"
Sep 15 09:13:59.104392 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:59.104373    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:13:59.112153 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:59.112129    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62"
Sep 15 09:13:59.120840 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:59.120822    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nx8dj"
Sep 15 09:13:59.128610 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:59.128588    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x9k52"
Sep 15 09:13:59.129982 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:59.129958    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:13:59.307183 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:59.307108    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:13:59.372710 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:59.372678    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs\") pod \"network-metrics-daemon-2jd2s\" (UID: \"05297e11-2660-4980-a495-baccd89ae99f\") " pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:13:59.372885 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:59.372836    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:13:59.372944 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:59.372912    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs podName:05297e11-2660-4980-a495-baccd89ae99f nodeName:}" failed. No retries permitted until 2026-09-15 09:14:00.37288873 +0000 UTC m=+4.022304845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs") pod "network-metrics-daemon-2jd2s" (UID: "05297e11-2660-4980-a495-baccd89ae99f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:13:59.473731 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:59.473691    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret\") pod \"global-pull-secret-syncer-rwg82\" (UID: \"12d964ec-1ded-49e8-bd7c-18c450406339\") " pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:13:59.473731 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:59.473729    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zxt7\" (UniqueName: \"kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7\") pod \"network-check-target-mcckq\" (UID: \"6b4c7605-a586-49d3-9cd7-b0d0502947aa\") " pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:13:59.473969 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:59.473832    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:13:59.473969 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:59.473889    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:13:59.473969 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:59.473904    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:13:59.473969 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:59.473906    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret podName:12d964ec-1ded-49e8-bd7c-18c450406339 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:00.473891199 +0000 UTC m=+4.123307274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret") pod "global-pull-secret-syncer-rwg82" (UID: "12d964ec-1ded-49e8-bd7c-18c450406339") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:13:59.473969 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:59.473914    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5zxt7 for pod openshift-network-diagnostics/network-check-target-mcckq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:13:59.473969 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:59.473962    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7 podName:6b4c7605-a586-49d3-9cd7-b0d0502947aa nodeName:}" failed. No retries permitted until 2026-09-15 09:14:00.473947189 +0000 UTC m=+4.123363279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zxt7" (UniqueName: "kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7") pod "network-check-target-mcckq" (UID: "6b4c7605-a586-49d3-9cd7-b0d0502947aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:13:59.796368 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:59.796182    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 09:08:58 +0000 UTC" deadline="2028-04-25 05:43:43.493244923 +0000 UTC"
Sep 15 09:13:59.796368 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:59.796365    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14108h29m43.6968841s"
Sep 15 09:13:59.852673 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:13:59.852638    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:13:59.852869 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:13:59.852788    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcckq" podUID="6b4c7605-a586-49d3-9cd7-b0d0502947aa"
Sep 15 09:13:59.951937 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:59.951822    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d0ce8f_b1f2_44b6_9d10_c2d3f19deb08.slice/crio-92bd6b7956c8528cccec91c7ba6dad0d0eaa310ba72267a6a87d439a904f845b WatchSource:0}: Error finding container 92bd6b7956c8528cccec91c7ba6dad0d0eaa310ba72267a6a87d439a904f845b: Status 404 returned error can't find the container with id 92bd6b7956c8528cccec91c7ba6dad0d0eaa310ba72267a6a87d439a904f845b
Sep 15 09:13:59.953291 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:59.953213    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda62ea6cf_29ca_41e9_854a_a2fa1c13fc53.slice/crio-b0599dda157b1ac6725cfc2ec6754756a32d18a4c5addd7d8dd3157bafe6151c WatchSource:0}: Error finding container b0599dda157b1ac6725cfc2ec6754756a32d18a4c5addd7d8dd3157bafe6151c: Status 404 returned error can't find the container with id b0599dda157b1ac6725cfc2ec6754756a32d18a4c5addd7d8dd3157bafe6151c
Sep 15 09:13:59.955094 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:59.954510    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c3a068_ccd8_48ce_9dd4_d703df179e99.slice/crio-9e7f4eade0700455bf9105b484043af0c8dd2dfa2ed5420e608baab5a92c9f89 WatchSource:0}: Error finding container 9e7f4eade0700455bf9105b484043af0c8dd2dfa2ed5420e608baab5a92c9f89: Status 404 returned error can't find the container with id 9e7f4eade0700455bf9105b484043af0c8dd2dfa2ed5420e608baab5a92c9f89
Sep 15 09:13:59.956546 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:59.956488    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeac2b225_b6a8_4a94_9206_81a230322573.slice/crio-701a862e36a0d8182ecf81c86d642d54bd1ba9770398e85dc49636f1c45a0be8 WatchSource:0}: Error finding container 701a862e36a0d8182ecf81c86d642d54bd1ba9770398e85dc49636f1c45a0be8: Status 404 returned error can't find the container with id 701a862e36a0d8182ecf81c86d642d54bd1ba9770398e85dc49636f1c45a0be8
Sep 15 09:13:59.958206 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:59.958098    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc865b47_353d_48c1_b3c4_8c51fbc97e44.slice/crio-6b04453729269a2a829360e9840cc81b0e49a70fc0d0bb792c9d84e1c9b4428d WatchSource:0}: Error finding container 6b04453729269a2a829360e9840cc81b0e49a70fc0d0bb792c9d84e1c9b4428d: Status 404 returned error can't find the container with id 6b04453729269a2a829360e9840cc81b0e49a70fc0d0bb792c9d84e1c9b4428d
Sep 15 09:13:59.965058 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:13:59.964892    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f3e00e_6b02_4341_af4c_3228fdb5f592.slice/crio-b58cc7753260e72383bb695065c0dd167d6a18c50306c208561b3ca1d993e064 WatchSource:0}: Error finding container b58cc7753260e72383bb695065c0dd167d6a18c50306c208561b3ca1d993e064: Status 404 returned error can't find the container with id b58cc7753260e72383bb695065c0dd167d6a18c50306c208561b3ca1d993e064
Sep 15 09:14:00.380107 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.380022    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs\") pod \"network-metrics-daemon-2jd2s\" (UID: \"05297e11-2660-4980-a495-baccd89ae99f\") " pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:00.380246 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:00.380136    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:00.380246 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:00.380190    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs podName:05297e11-2660-4980-a495-baccd89ae99f nodeName:}" failed. No retries permitted until 2026-09-15 09:14:02.380173265 +0000 UTC m=+6.029589336 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs") pod "network-metrics-daemon-2jd2s" (UID: "05297e11-2660-4980-a495-baccd89ae99f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:00.480360 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.480323    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret\") pod \"global-pull-secret-syncer-rwg82\" (UID: \"12d964ec-1ded-49e8-bd7c-18c450406339\") " pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:00.480511 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.480372    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zxt7\" (UniqueName: \"kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7\") pod \"network-check-target-mcckq\" (UID: \"6b4c7605-a586-49d3-9cd7-b0d0502947aa\") " pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:00.480586 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:00.480554    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:14:00.480586 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:00.480571    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:14:00.480586 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:00.480584    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5zxt7 for pod openshift-network-diagnostics/network-check-target-mcckq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:00.480738 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:00.480642    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7 podName:6b4c7605-a586-49d3-9cd7-b0d0502947aa nodeName:}" failed. No retries permitted until 2026-09-15 09:14:02.480624542 +0000 UTC m=+6.130040615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zxt7" (UniqueName: "kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7") pod "network-check-target-mcckq" (UID: "6b4c7605-a586-49d3-9cd7-b0d0502947aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:00.481077 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:00.481054    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:00.481154 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:00.481116    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret podName:12d964ec-1ded-49e8-bd7c-18c450406339 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:02.481100356 +0000 UTC m=+6.130516433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret") pod "global-pull-secret-syncer-rwg82" (UID: "12d964ec-1ded-49e8-bd7c-18c450406339") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:00.797514 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.797405    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 09:08:58 +0000 UTC" deadline="2028-05-26 16:39:03.043980546 +0000 UTC"
Sep 15 09:14:00.797514 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.797464    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14863h25m2.246520961s"
Sep 15 09:14:00.855300 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.855266    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:00.855463 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:00.855396    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwg82" podUID="12d964ec-1ded-49e8-bd7c-18c450406339"
Sep 15 09:14:00.855866 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.855796    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:00.855975 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:00.855906    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd2s" podUID="05297e11-2660-4980-a495-baccd89ae99f"
Sep 15 09:14:00.879827 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.879788    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-31.ec2.internal" event={"ID":"3ff8a0f9e53340a35ae68e0eed981df6","Type":"ContainerStarted","Data":"885a3b73f578054b12adf6e4df4d59c8c6424cfce5d0d2974edac0e550ffd9d0"}
Sep 15 09:14:00.887647 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.887615    2575 generic.go:356] "Generic (PLEG): container finished" podID="526f8918c1338e8bd0bec33e26ffd059" containerID="73643f9e7a98c81821e4ca583abfc51e16195bb8dbf41f4f035a437d64b4f0ff" exitCode=0
Sep 15 09:14:00.887815 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.887701    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal" event={"ID":"526f8918c1338e8bd0bec33e26ffd059","Type":"ContainerDied","Data":"73643f9e7a98c81821e4ca583abfc51e16195bb8dbf41f4f035a437d64b4f0ff"}
Sep 15 09:14:00.894278 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.894224    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-31.ec2.internal" podStartSLOduration=2.894205784 podStartE2EDuration="2.894205784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:13:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:00.893910529 +0000 UTC m=+4.543326622" watchObservedRunningTime="2026-09-15 09:14:00.894205784 +0000 UTC m=+4.543621882"
Sep 15 09:14:00.900582 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.900558    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r9vwv" event={"ID":"41dd441e-8166-484d-bc4a-b54748d09062","Type":"ContainerStarted","Data":"626642ba41189ffd0d9d454bf6c7f59a6f71599084b4fc99e45c0345fb35a703"}
Sep 15 09:14:00.914278 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.914191    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nx8dj" event={"ID":"6272a978-5c5f-452a-88c0-91affa1d942c","Type":"ContainerStarted","Data":"ccf62b7c85f33682345315fa2aa180ebb30ee86b4774ba2e56bcb44377bde05b"}
Sep 15 09:14:00.926665 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.926595    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qq5qv" event={"ID":"a62ea6cf-29ca-41e9-854a-a2fa1c13fc53","Type":"ContainerStarted","Data":"b0599dda157b1ac6725cfc2ec6754756a32d18a4c5addd7d8dd3157bafe6151c"}
Sep 15 09:14:00.942281 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.942251    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8fznm" event={"ID":"06f3e00e-6b02-4341-af4c-3228fdb5f592","Type":"ContainerStarted","Data":"b58cc7753260e72383bb695065c0dd167d6a18c50306c208561b3ca1d993e064"}
Sep 15 09:14:00.950574 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.950320    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hgkhw" event={"ID":"f3ac0b66-da35-4fc2-964a-e6583ff9a29f","Type":"ContainerStarted","Data":"fa92d7840a367056a8378c0f585fd19c34fc804fef2dad6e7a76487d9efeed21"}
Sep 15 09:14:00.958344 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.958315    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj965" event={"ID":"dc865b47-353d-48c1-b3c4-8c51fbc97e44","Type":"ContainerStarted","Data":"6b04453729269a2a829360e9840cc81b0e49a70fc0d0bb792c9d84e1c9b4428d"}
Sep 15 09:14:00.976053 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.975978    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x9k52" event={"ID":"eac2b225-b6a8-4a94-9206-81a230322573","Type":"ContainerStarted","Data":"701a862e36a0d8182ecf81c86d642d54bd1ba9770398e85dc49636f1c45a0be8"}
Sep 15 09:14:00.990007 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.989801    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62" event={"ID":"26c3a068-ccd8-48ce-9dd4-d703df179e99","Type":"ContainerStarted","Data":"9e7f4eade0700455bf9105b484043af0c8dd2dfa2ed5420e608baab5a92c9f89"}
Sep 15 09:14:00.992830 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:00.992617    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8t8sv" event={"ID":"e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08","Type":"ContainerStarted","Data":"92bd6b7956c8528cccec91c7ba6dad0d0eaa310ba72267a6a87d439a904f845b"}
Sep 15 09:14:01.852959 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:01.852929    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:01.853416 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:01.853027    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcckq" podUID="6b4c7605-a586-49d3-9cd7-b0d0502947aa"
Sep 15 09:14:02.021015 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:02.020979    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal" event={"ID":"526f8918c1338e8bd0bec33e26ffd059","Type":"ContainerStarted","Data":"e447b304e362588eba89f2364aa0304426ebebb98ee0a47c112bb9b93caf3624"}
Sep 15 09:14:02.035109 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:02.035046    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-31.ec2.internal" podStartSLOduration=4.035027132 podStartE2EDuration="4.035027132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:13:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:02.034659408 +0000 UTC m=+5.684075503" watchObservedRunningTime="2026-09-15 09:14:02.035027132 +0000 UTC m=+5.684443225"
Sep 15 09:14:02.397507 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:02.396977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs\") pod \"network-metrics-daemon-2jd2s\" (UID: \"05297e11-2660-4980-a495-baccd89ae99f\") " pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:02.397507 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:02.397137    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:02.397507 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:02.397201    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs podName:05297e11-2660-4980-a495-baccd89ae99f nodeName:}" failed. No retries permitted until 2026-09-15 09:14:06.397182009 +0000 UTC m=+10.046598097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs") pod "network-metrics-daemon-2jd2s" (UID: "05297e11-2660-4980-a495-baccd89ae99f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:02.498155 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:02.497293    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret\") pod \"global-pull-secret-syncer-rwg82\" (UID: \"12d964ec-1ded-49e8-bd7c-18c450406339\") " pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:02.498155 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:02.497344    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zxt7\" (UniqueName: \"kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7\") pod \"network-check-target-mcckq\" (UID: \"6b4c7605-a586-49d3-9cd7-b0d0502947aa\") " pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:02.498155 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:02.497543    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:14:02.498155 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:02.497561    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:14:02.498155 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:02.497575    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5zxt7 for pod openshift-network-diagnostics/network-check-target-mcckq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:02.498155 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:02.497632    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7 podName:6b4c7605-a586-49d3-9cd7-b0d0502947aa nodeName:}" failed. No retries permitted until 2026-09-15 09:14:06.497614543 +0000 UTC m=+10.147030628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zxt7" (UniqueName: "kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7") pod "network-check-target-mcckq" (UID: "6b4c7605-a586-49d3-9cd7-b0d0502947aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:02.498155 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:02.498037    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:02.498155 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:02.498092    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret podName:12d964ec-1ded-49e8-bd7c-18c450406339 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:06.498075119 +0000 UTC m=+10.147491208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret") pod "global-pull-secret-syncer-rwg82" (UID: "12d964ec-1ded-49e8-bd7c-18c450406339") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:02.854457 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:02.854377    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:02.854904 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:02.854498    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwg82" podUID="12d964ec-1ded-49e8-bd7c-18c450406339"
Sep 15 09:14:02.854904 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:02.854874    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:02.855028 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:02.855000    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd2s" podUID="05297e11-2660-4980-a495-baccd89ae99f"
Sep 15 09:14:03.853041 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:03.853003    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:03.853232 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:03.853139    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcckq" podUID="6b4c7605-a586-49d3-9cd7-b0d0502947aa"
Sep 15 09:14:04.854965 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:04.854928    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:04.855437 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:04.855056    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwg82" podUID="12d964ec-1ded-49e8-bd7c-18c450406339"
Sep 15 09:14:04.855437 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:04.855428    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:04.855553 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:04.855524    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd2s" podUID="05297e11-2660-4980-a495-baccd89ae99f"
Sep 15 09:14:05.853113 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:05.853019    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:05.853284 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:05.853177    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcckq" podUID="6b4c7605-a586-49d3-9cd7-b0d0502947aa"
Sep 15 09:14:06.430516 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:06.430475    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs\") pod \"network-metrics-daemon-2jd2s\" (UID: \"05297e11-2660-4980-a495-baccd89ae99f\") " pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:06.430966 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:06.430672    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:06.430966 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:06.430757    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs podName:05297e11-2660-4980-a495-baccd89ae99f nodeName:}" failed. No retries permitted until 2026-09-15 09:14:14.430717604 +0000 UTC m=+18.080133678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs") pod "network-metrics-daemon-2jd2s" (UID: "05297e11-2660-4980-a495-baccd89ae99f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:06.531829 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:06.531791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret\") pod \"global-pull-secret-syncer-rwg82\" (UID: \"12d964ec-1ded-49e8-bd7c-18c450406339\") " pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:06.531994 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:06.531842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zxt7\" (UniqueName: \"kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7\") pod \"network-check-target-mcckq\" (UID: \"6b4c7605-a586-49d3-9cd7-b0d0502947aa\") " pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:06.531994 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:06.531971    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:06.531994 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:06.531988    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:14:06.532125 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:06.532001    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:14:06.532125 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:06.532011    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5zxt7 for pod openshift-network-diagnostics/network-check-target-mcckq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:06.532125 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:06.532047    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret podName:12d964ec-1ded-49e8-bd7c-18c450406339 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:14.532025953 +0000 UTC m=+18.181442034 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret") pod "global-pull-secret-syncer-rwg82" (UID: "12d964ec-1ded-49e8-bd7c-18c450406339") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:06.532125 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:06.532066    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7 podName:6b4c7605-a586-49d3-9cd7-b0d0502947aa nodeName:}" failed. No retries permitted until 2026-09-15 09:14:14.532059074 +0000 UTC m=+18.181475144 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zxt7" (UniqueName: "kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7") pod "network-check-target-mcckq" (UID: "6b4c7605-a586-49d3-9cd7-b0d0502947aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:06.853735 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:06.853655    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:06.853919 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:06.853756    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd2s" podUID="05297e11-2660-4980-a495-baccd89ae99f"
Sep 15 09:14:06.854169 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:06.854154    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:06.854253 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:06.854232    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwg82" podUID="12d964ec-1ded-49e8-bd7c-18c450406339"
Sep 15 09:14:07.853135 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:07.853009    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:07.853629 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:07.853455    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcckq" podUID="6b4c7605-a586-49d3-9cd7-b0d0502947aa"
Sep 15 09:14:08.854250 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:08.854220    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:08.854693 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:08.854354    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd2s" podUID="05297e11-2660-4980-a495-baccd89ae99f"
Sep 15 09:14:08.854826 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:08.854170    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:08.854998 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:08.854918    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwg82" podUID="12d964ec-1ded-49e8-bd7c-18c450406339"
Sep 15 09:14:09.852399 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:09.852363    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:09.852565 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:09.852466    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcckq" podUID="6b4c7605-a586-49d3-9cd7-b0d0502947aa"
Sep 15 09:14:10.853287 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:10.853209    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:10.853690 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:10.853212    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:10.853690 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:10.853332    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwg82" podUID="12d964ec-1ded-49e8-bd7c-18c450406339"
Sep 15 09:14:10.853690 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:10.853436    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd2s" podUID="05297e11-2660-4980-a495-baccd89ae99f"
Sep 15 09:14:11.852397 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:11.852364    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:11.852552 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:11.852497    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcckq" podUID="6b4c7605-a586-49d3-9cd7-b0d0502947aa"
Sep 15 09:14:12.853057 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:12.852865    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:12.853514 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:12.852865    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:12.853514 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:12.853159    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwg82" podUID="12d964ec-1ded-49e8-bd7c-18c450406339"
Sep 15 09:14:12.853514 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:12.853200    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd2s" podUID="05297e11-2660-4980-a495-baccd89ae99f"
Sep 15 09:14:13.852983 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:13.852949    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:13.853287 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:13.853073    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcckq" podUID="6b4c7605-a586-49d3-9cd7-b0d0502947aa"
Sep 15 09:14:14.488237 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:14.488194    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs\") pod \"network-metrics-daemon-2jd2s\" (UID: \"05297e11-2660-4980-a495-baccd89ae99f\") " pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:14.488424 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:14.488375    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:14.488480 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:14.488457    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs podName:05297e11-2660-4980-a495-baccd89ae99f nodeName:}" failed. No retries permitted until 2026-09-15 09:14:30.488434431 +0000 UTC m=+34.137850509 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs") pod "network-metrics-daemon-2jd2s" (UID: "05297e11-2660-4980-a495-baccd89ae99f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:14.588971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:14.588940    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret\") pod \"global-pull-secret-syncer-rwg82\" (UID: \"12d964ec-1ded-49e8-bd7c-18c450406339\") " pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:14.589161 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:14.588983    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zxt7\" (UniqueName: \"kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7\") pod \"network-check-target-mcckq\" (UID: \"6b4c7605-a586-49d3-9cd7-b0d0502947aa\") " pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:14.589161 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:14.589116    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:14.589161 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:14.589139    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:14:14.589161 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:14.589161    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:14:14.589370 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:14.589175    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5zxt7 for pod openshift-network-diagnostics/network-check-target-mcckq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:14.589370 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:14.589188    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret podName:12d964ec-1ded-49e8-bd7c-18c450406339 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:30.589170403 +0000 UTC m=+34.238586661 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret") pod "global-pull-secret-syncer-rwg82" (UID: "12d964ec-1ded-49e8-bd7c-18c450406339") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:14.589370 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:14.589221    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7 podName:6b4c7605-a586-49d3-9cd7-b0d0502947aa nodeName:}" failed. No retries permitted until 2026-09-15 09:14:30.589207582 +0000 UTC m=+34.238623656 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zxt7" (UniqueName: "kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7") pod "network-check-target-mcckq" (UID: "6b4c7605-a586-49d3-9cd7-b0d0502947aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:14.852884 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:14.852810    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:14.853029 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:14.852812    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:14.853029 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:14.852952    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd2s" podUID="05297e11-2660-4980-a495-baccd89ae99f"
Sep 15 09:14:14.853106 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:14.853029    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwg82" podUID="12d964ec-1ded-49e8-bd7c-18c450406339"
Sep 15 09:14:15.852378 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:15.852337    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:15.852755 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:15.852481    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcckq" podUID="6b4c7605-a586-49d3-9cd7-b0d0502947aa"
Sep 15 09:14:16.858016 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:16.857981    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:16.858488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:16.858150    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:16.858557 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:16.858530    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd2s" podUID="05297e11-2660-4980-a495-baccd89ae99f"
Sep 15 09:14:16.858614 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:16.858531    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwg82" podUID="12d964ec-1ded-49e8-bd7c-18c450406339"
Sep 15 09:14:17.852234 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:17.852202    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:17.852374 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:17.852308    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcckq" podUID="6b4c7605-a586-49d3-9cd7-b0d0502947aa"
Sep 15 09:14:18.856953 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:18.856688    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:18.857486 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:18.856736    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:18.857486 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:18.857065    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwg82" podUID="12d964ec-1ded-49e8-bd7c-18c450406339"
Sep 15 09:14:18.857486 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:18.857142    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd2s" podUID="05297e11-2660-4980-a495-baccd89ae99f"
Sep 15 09:14:19.058255 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.058165    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8fznm" event={"ID":"06f3e00e-6b02-4341-af4c-3228fdb5f592","Type":"ContainerStarted","Data":"1eb8167e268135776437eb2760fc89cc56bee80c4143bd2aee4c8e1fb5ec2fb9"}
Sep 15 09:14:19.059997 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.059966    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hgkhw" event={"ID":"f3ac0b66-da35-4fc2-964a-e6583ff9a29f","Type":"ContainerStarted","Data":"99227144e061d57857d03de708ae821fc1246e962cbcf70d38bc06925c301147"}
Sep 15 09:14:19.063142 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.063118    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:14:19.063508 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.063486    2575 generic.go:356] "Generic (PLEG): container finished" podID="dc865b47-353d-48c1-b3c4-8c51fbc97e44" containerID="4736a60cacaab6941d9d210e0f857e74346153739719e2dbf6b9e7bf38aec968" exitCode=1
Sep 15 09:14:19.063608 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.063561    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj965" event={"ID":"dc865b47-353d-48c1-b3c4-8c51fbc97e44","Type":"ContainerStarted","Data":"13f27311e1cf8e70980ec72d8ff67d6951c158e43424f388a3950f64cb13d962"}
Sep 15 09:14:19.063668 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.063638    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj965" event={"ID":"dc865b47-353d-48c1-b3c4-8c51fbc97e44","Type":"ContainerStarted","Data":"c6682f3a0058b39e36003613dbab93b724d695ae5c7695516aeb7c9aba48e49c"}
Sep 15 09:14:19.063726 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.063672    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj965" event={"ID":"dc865b47-353d-48c1-b3c4-8c51fbc97e44","Type":"ContainerStarted","Data":"2f3a40b582f79f6868bcdc02ed9adfbe851825123a7382338b15e963242b5f72"}
Sep 15 09:14:19.063726 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.063705    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj965" event={"ID":"dc865b47-353d-48c1-b3c4-8c51fbc97e44","Type":"ContainerStarted","Data":"db432f32e266384dc6c0d4a3322f26e56aeb714c89a587d55a3a7b99b94c9ea2"}
Sep 15 09:14:19.063856 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.063734    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj965" event={"ID":"dc865b47-353d-48c1-b3c4-8c51fbc97e44","Type":"ContainerDied","Data":"4736a60cacaab6941d9d210e0f857e74346153739719e2dbf6b9e7bf38aec968"}
Sep 15 09:14:19.063856 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.063783    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj965" event={"ID":"dc865b47-353d-48c1-b3c4-8c51fbc97e44","Type":"ContainerStarted","Data":"a579f72106d00648173bcad4116507c104a08c59f95a47446f640c3b108b7f5b"}
Sep 15 09:14:19.065146 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.065115    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x9k52" event={"ID":"eac2b225-b6a8-4a94-9206-81a230322573","Type":"ContainerStarted","Data":"51e42a3cae97d54b58b26d4a7e285af5b63e3b45abf3e942ff1c2d67a0ad6250"}
Sep 15 09:14:19.066751 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.066728    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62" event={"ID":"26c3a068-ccd8-48ce-9dd4-d703df179e99","Type":"ContainerStarted","Data":"b5ee4f73cb5c774e64ab857d3109e50766009cd64023bace4c28d2137d30edd6"}
Sep 15 09:14:19.068310 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.068268    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8t8sv" event={"ID":"e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08","Type":"ContainerStarted","Data":"9e898580c6297f6a023cfb96404d434960ca1fad576f15b324164e6f5bcb1124"}
Sep 15 09:14:19.069914 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.069894    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r9vwv" event={"ID":"41dd441e-8166-484d-bc4a-b54748d09062","Type":"ContainerStarted","Data":"fbd3d8f500fca63786eb79b5756ae5755ab897b985c08f56ea012c7da49cfe81"}
Sep 15 09:14:19.071699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.071674    2575 generic.go:356] "Generic (PLEG): container finished" podID="6272a978-5c5f-452a-88c0-91affa1d942c" containerID="29b3fa1bf90736b7c183f0cfaebd6a58dfee03168d07ba9d958a5ac57ce76e3d" exitCode=0
Sep 15 09:14:19.071805 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.071704    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nx8dj" event={"ID":"6272a978-5c5f-452a-88c0-91affa1d942c","Type":"ContainerDied","Data":"29b3fa1bf90736b7c183f0cfaebd6a58dfee03168d07ba9d958a5ac57ce76e3d"}
Sep 15 09:14:19.073014 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.072978    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8fznm" podStartSLOduration=3.951938304 podStartE2EDuration="22.072966635s" totalImagesPullingTime="18.121028331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:19.072684072 +0000 UTC m=+22.722100165" watchObservedRunningTime="2026-09-15 09:14:19.072966635 +0000 UTC m=+22.722382727"
Sep 15 09:14:19.090362 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.090318    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r9vwv" podStartSLOduration=3.964967139 podStartE2EDuration="22.090304707s" totalImagesPullingTime="18.125337568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:19.089791501 +0000 UTC m=+22.739207599" watchObservedRunningTime="2026-09-15 09:14:19.090304707 +0000 UTC m=+22.739720799"
Sep 15 09:14:19.103997 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.103960    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8t8sv" podStartSLOduration=11.598435828 podStartE2EDuration="22.103947101s" totalImagesPullingTime="10.505511273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:19.103626966 +0000 UTC m=+22.753043062" watchObservedRunningTime="2026-09-15 09:14:19.103947101 +0000 UTC m=+22.753363193"
Sep 15 09:14:19.145906 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.145848    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x9k52" podStartSLOduration=3.681936859 podStartE2EDuration="22.145829186s" totalImagesPullingTime="18.463892327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:19.145170415 +0000 UTC m=+22.794586508" watchObservedRunningTime="2026-09-15 09:14:19.145829186 +0000 UTC m=+22.795245279"
Sep 15 09:14:19.160116 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.160069    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hgkhw" podStartSLOduration=4.036062186 podStartE2EDuration="22.160057012s" totalImagesPullingTime="18.123994826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:19.159879698 +0000 UTC m=+22.809295783" watchObservedRunningTime="2026-09-15 09:14:19.160057012 +0000 UTC m=+22.809473105"
Sep 15 09:14:19.391496 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.391446    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 09:14:19.821618 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.821420    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T09:14:19.391463439Z","UUID":"967db365-5080-4753-92d3-715e39e04264","Handler":null,"Name":"","Endpoint":""}
Sep 15 09:14:19.823075 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.823051    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 09:14:19.823218 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.823089    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 09:14:19.852980 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:19.852955    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:19.853114 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:19.853061    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcckq" podUID="6b4c7605-a586-49d3-9cd7-b0d0502947aa"
Sep 15 09:14:20.077420 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:20.077342    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62" event={"ID":"26c3a068-ccd8-48ce-9dd4-d703df179e99","Type":"ContainerStarted","Data":"7dfde675d11fd3531a31a3c8057b6d97094dcacf0b7db3b081c779b84f5c926b"}
Sep 15 09:14:20.079538 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:20.079453    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qq5qv" event={"ID":"a62ea6cf-29ca-41e9-854a-a2fa1c13fc53","Type":"ContainerStarted","Data":"1729c14b3e8aacfce9fa237e074cd8ae41f4e3dee94a5acee1f464fdba3b7086"}
Sep 15 09:14:20.099604 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:20.099539    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qq5qv" podStartSLOduration=4.967809879 podStartE2EDuration="23.099518644s" totalImagesPullingTime="18.131708765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:20.09849136 +0000 UTC m=+23.747907453" watchObservedRunningTime="2026-09-15 09:14:20.099518644 +0000 UTC m=+23.748934743"
Sep 15 09:14:20.853747 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:20.853494    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:20.853938 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:20.853917    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd2s" podUID="05297e11-2660-4980-a495-baccd89ae99f"
Sep 15 09:14:20.854235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:20.853521    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:20.854334 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:20.854315    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwg82" podUID="12d964ec-1ded-49e8-bd7c-18c450406339"
Sep 15 09:14:21.086033 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:21.085924    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:14:21.086452 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:21.086386    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj965" event={"ID":"dc865b47-353d-48c1-b3c4-8c51fbc97e44","Type":"ContainerStarted","Data":"1bf031557b8b2c9498a0c69e662607c07f6f9d86a77e7356cef8385f55900dd6"}
Sep 15 09:14:21.088969 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:21.088940    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62" event={"ID":"26c3a068-ccd8-48ce-9dd4-d703df179e99","Type":"ContainerStarted","Data":"dea96d4208d6b885b486d14be2d2b7c03e9ddb3488a633f338ba3033114e5a50"}
Sep 15 09:14:21.107377 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:21.107329    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvb62" podStartSLOduration=3.977681816 podStartE2EDuration="24.107311819s" totalImagesPullingTime="20.129630003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:13:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:21.107232547 +0000 UTC m=+24.756648640" watchObservedRunningTime="2026-09-15 09:14:21.107311819 +0000 UTC m=+24.756727911"
Sep 15 09:14:21.446970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:21.446932    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8t8sv"
Sep 15 09:14:21.447541 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:21.447516    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8t8sv"
Sep 15 09:14:21.853206 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:21.853128    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:21.853344 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:21.853231    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcckq" podUID="6b4c7605-a586-49d3-9cd7-b0d0502947aa"
Sep 15 09:14:22.091857 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:22.091823    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8t8sv"
Sep 15 09:14:22.092368 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:22.092347    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8t8sv"
Sep 15 09:14:22.852521 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:22.852494    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:22.852680 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:22.852631    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd2s" podUID="05297e11-2660-4980-a495-baccd89ae99f"
Sep 15 09:14:22.852680 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:22.852637    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:22.852781 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:22.852712    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwg82" podUID="12d964ec-1ded-49e8-bd7c-18c450406339"
Sep 15 09:14:23.853453 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:23.853216    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:23.853802 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:23.853492    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcckq" podUID="6b4c7605-a586-49d3-9cd7-b0d0502947aa"
Sep 15 09:14:24.097152 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:24.097119    2575 generic.go:356] "Generic (PLEG): container finished" podID="6272a978-5c5f-452a-88c0-91affa1d942c" containerID="a69cf34185b4ab467711d593fca110cd316ef9cf3abcb1e0e1ca8d1a50dd1cec" exitCode=0
Sep 15 09:14:24.097334 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:24.097198    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nx8dj" event={"ID":"6272a978-5c5f-452a-88c0-91affa1d942c","Type":"ContainerDied","Data":"a69cf34185b4ab467711d593fca110cd316ef9cf3abcb1e0e1ca8d1a50dd1cec"}
Sep 15 09:14:24.101064 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:24.101037    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:14:24.101447 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:24.101429    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj965" event={"ID":"dc865b47-353d-48c1-b3c4-8c51fbc97e44","Type":"ContainerStarted","Data":"2ab09f3c303446c6d693b6da91dda6419b2e121e89c4bff114a818d49339eaaa"}
Sep 15 09:14:24.101825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:24.101812    2575 scope.go:117] "RemoveContainer" containerID="4736a60cacaab6941d9d210e0f857e74346153739719e2dbf6b9e7bf38aec968"
Sep 15 09:14:24.365975 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:24.365902    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:14:24.856401 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:24.856371    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:24.857047 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:24.856377    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:24.857047 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:24.856509    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwg82" podUID="12d964ec-1ded-49e8-bd7c-18c450406339"
Sep 15 09:14:24.857047 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:24.856569    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd2s" podUID="05297e11-2660-4980-a495-baccd89ae99f"
Sep 15 09:14:25.110696 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:25.110649    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:14:25.111067 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:25.111047    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj965" event={"ID":"dc865b47-353d-48c1-b3c4-8c51fbc97e44","Type":"ContainerStarted","Data":"fe73bcc9ac8cef4ffed214dd7edde9f6a661dacd1707bc79b5cdfe453e3780f8"}
Sep 15 09:14:25.111333 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:25.111311    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:14:25.111449 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:25.111398    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:14:25.113615 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:25.113585    2575 generic.go:356] "Generic (PLEG): container finished" podID="6272a978-5c5f-452a-88c0-91affa1d942c" containerID="59f45d4ffa11b2f9517ac2ab6c43d78ffa283ef27424ddb5984789d365a881f4" exitCode=0
Sep 15 09:14:25.113702 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:25.113622    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nx8dj" event={"ID":"6272a978-5c5f-452a-88c0-91affa1d942c","Type":"ContainerDied","Data":"59f45d4ffa11b2f9517ac2ab6c43d78ffa283ef27424ddb5984789d365a881f4"}
Sep 15 09:14:25.127446 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:25.127424    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:14:25.127571 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:25.127557    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:14:25.141784 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:25.141718    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hj965" podStartSLOduration=9.980562333 podStartE2EDuration="28.14169949s" totalImagesPullingTime="18.161137157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:25.141252595 +0000 UTC m=+28.790668692" watchObservedRunningTime="2026-09-15 09:14:25.14169949 +0000 UTC m=+28.791115587"
Sep 15 09:14:25.144140 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:25.144110    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rwg82"]
Sep 15 09:14:25.144238 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:25.144205    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:25.144313 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:25.144291    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwg82" podUID="12d964ec-1ded-49e8-bd7c-18c450406339"
Sep 15 09:14:25.145012 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:25.144993    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mcckq"]
Sep 15 09:14:25.145103 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:25.145090    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:25.145200 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:25.145182    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcckq" podUID="6b4c7605-a586-49d3-9cd7-b0d0502947aa"
Sep 15 09:14:25.155941 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:25.155921    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2jd2s"]
Sep 15 09:14:25.156051 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:25.156022    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:25.156122 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:25.156105    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd2s" podUID="05297e11-2660-4980-a495-baccd89ae99f"
Sep 15 09:14:26.118807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:26.118528    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nx8dj" event={"ID":"6272a978-5c5f-452a-88c0-91affa1d942c","Type":"ContainerStarted","Data":"270f1388bf0c0606aea570e270c21bc19c0375d1f9e415d5db4995d37e8bcb45"}
Sep 15 09:14:26.853468 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:26.853438    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:26.853627 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:26.853533    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd2s" podUID="05297e11-2660-4980-a495-baccd89ae99f"
Sep 15 09:14:26.853627 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:26.853550    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:26.853627 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:26.853602    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:26.853800 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:26.853678    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcckq" podUID="6b4c7605-a586-49d3-9cd7-b0d0502947aa"
Sep 15 09:14:26.853866 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:26.853797    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwg82" podUID="12d964ec-1ded-49e8-bd7c-18c450406339"
Sep 15 09:14:27.124248 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:27.124164    2575 generic.go:356] "Generic (PLEG): container finished" podID="6272a978-5c5f-452a-88c0-91affa1d942c" containerID="270f1388bf0c0606aea570e270c21bc19c0375d1f9e415d5db4995d37e8bcb45" exitCode=0
Sep 15 09:14:27.124680 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:27.124240    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nx8dj" event={"ID":"6272a978-5c5f-452a-88c0-91affa1d942c","Type":"ContainerDied","Data":"270f1388bf0c0606aea570e270c21bc19c0375d1f9e415d5db4995d37e8bcb45"}
Sep 15 09:14:28.853321 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:28.853244    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:28.853321 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:28.853276    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:28.853806 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:28.853244    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:28.853806 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:28.853381    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jd2s" podUID="05297e11-2660-4980-a495-baccd89ae99f"
Sep 15 09:14:28.853806 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:28.853458    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwg82" podUID="12d964ec-1ded-49e8-bd7c-18c450406339"
Sep 15 09:14:28.853806 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:28.853528    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcckq" podUID="6b4c7605-a586-49d3-9cd7-b0d0502947aa"
Sep 15 09:14:30.185751 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.185724    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-31.ec2.internal" event="NodeReady"
Sep 15 09:14:30.186403 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.185913    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 09:14:30.218550 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.218521    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56ff45949-wvktt"]
Sep 15 09:14:30.257489 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.257460    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6r9pn"]
Sep 15 09:14:30.260792 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.258266    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.264180 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.264155    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 15 09:14:30.264595 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.264574    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 15 09:14:30.264714 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.264642    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pc6pr\""
Sep 15 09:14:30.264891 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.264862    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 15 09:14:30.272677 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.272221    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 15 09:14:30.274394 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.273640    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg"]
Sep 15 09:14:30.274394 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.273793    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6r9pn"
Sep 15 09:14:30.279235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.276064    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-b94kx\""
Sep 15 09:14:30.279235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.276626    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 15 09:14:30.279235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.276714    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:14:30.297146 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.297121    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-t9m6q"]
Sep 15 09:14:30.297318 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.297300    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg"
Sep 15 09:14:30.299668 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.299649    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 15 09:14:30.299877 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.299860    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 15 09:14:30.299981 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.299898    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dm5rk\""
Sep 15 09:14:30.300163 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.300139    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 15 09:14:30.300262 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.300166    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:14:30.317425 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.317404    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb"]
Sep 15 09:14:30.317528 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.317502    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:14:30.320066 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.320046    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 15 09:14:30.320265 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.320251    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9pnbb\""
Sep 15 09:14:30.321104 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.320789    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:14:30.322128 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.321157    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 15 09:14:30.322128 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.321650    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 15 09:14:30.326369 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.325647    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 15 09:14:30.331299 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.331278    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"]
Sep 15 09:14:30.331420 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.331407    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb"
Sep 15 09:14:30.334115 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.334094    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 15 09:14:30.334636 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.334610    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8cswm\""
Sep 15 09:14:30.334898 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.334878    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:14:30.334988 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.334882    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 15 09:14:30.347383 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.347367    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zntgf"]
Sep 15 09:14:30.347477 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.347458    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:14:30.350394 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.350371    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9p5qr\""
Sep 15 09:14:30.350747 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.350505    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 15 09:14:30.350747 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.350582    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 09:14:30.350913 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.350583    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 09:14:30.351558 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.351402    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 15 09:14:30.367003 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.366982    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw"]
Sep 15 09:14:30.367117 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.367095    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zntgf"
Sep 15 09:14:30.369404 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.369383    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 09:14:30.369528 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.369507    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r95hw\""
Sep 15 09:14:30.369528 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.369511    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 09:14:30.389895 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.389855    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-2wvs2"]
Sep 15 09:14:30.389993 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.389935    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw"
Sep 15 09:14:30.392553 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.392532    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 15 09:14:30.392669 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.392538    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-f9pbq\""
Sep 15 09:14:30.392900 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.392878    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 15 09:14:30.393021 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.392921    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 15 09:14:30.393021 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.392989    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:14:30.398220 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.398199    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:30.407824 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.407802    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6r9pn"]
Sep 15 09:14:30.407912 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.407838    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56ff45949-wvktt"]
Sep 15 09:14:30.407912 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.407889    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.408016 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.407997    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d44h8"]
Sep 15 09:14:30.408086 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.408073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1433d91-fffc-49fe-b0e7-0ec14fa27689-ca-trust-extracted\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.408836 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.408098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94c76993-536e-4925-990b-8244b58c8879-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xz7jg\" (UID: \"94c76993-536e-4925-990b-8244b58c8879\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg"
Sep 15 09:14:30.408836 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.408442    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19bd1cc7-62fa-4d3e-b603-90af4ec6d509-trusted-ca\") pod \"console-operator-696884fb9c-t9m6q\" (UID: \"19bd1cc7-62fa-4d3e-b603-90af4ec6d509\") " pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:14:30.408836 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.408512    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1433d91-fffc-49fe-b0e7-0ec14fa27689-installation-pull-secrets\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.408836 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.408552    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1433d91-fffc-49fe-b0e7-0ec14fa27689-trusted-ca\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.408836 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.408575    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-bound-sa-token\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.408836 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.408605    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqgsk\" (UniqueName: \"kubernetes.io/projected/f495280a-a90e-4da0-9651-85113acabb38-kube-api-access-pqgsk\") pod \"cluster-samples-operator-86499c89c4-ctxmb\" (UID: \"f495280a-a90e-4da0-9651-85113acabb38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb"
Sep 15 09:14:30.408836 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.408691    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1433d91-fffc-49fe-b0e7-0ec14fa27689-image-registry-private-configuration\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.408836 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.408739    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.408836 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.408800    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9qnf\" (UniqueName: \"kubernetes.io/projected/94c76993-536e-4925-990b-8244b58c8879-kube-api-access-t9qnf\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xz7jg\" (UID: \"94c76993-536e-4925-990b-8244b58c8879\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg"
Sep 15 09:14:30.409339 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.408942    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtzbk\" (UniqueName: \"kubernetes.io/projected/8762be19-3c51-4ef7-8df4-ee06993466ad-kube-api-access-dtzbk\") pod \"volume-data-source-validator-86695b7cc7-6r9pn\" (UID: \"8762be19-3c51-4ef7-8df4-ee06993466ad\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6r9pn"
Sep 15 09:14:30.409391 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.409245    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19bd1cc7-62fa-4d3e-b603-90af4ec6d509-serving-cert\") pod \"console-operator-696884fb9c-t9m6q\" (UID: \"19bd1cc7-62fa-4d3e-b603-90af4ec6d509\") " pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:14:30.409441 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.409406    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vjq2\" (UniqueName: \"kubernetes.io/projected/19bd1cc7-62fa-4d3e-b603-90af4ec6d509-kube-api-access-8vjq2\") pod \"console-operator-696884fb9c-t9m6q\" (UID: \"19bd1cc7-62fa-4d3e-b603-90af4ec6d509\") " pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:14:30.409493 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.409447    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ctxmb\" (UID: \"f495280a-a90e-4da0-9651-85113acabb38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb"
Sep 15 09:14:30.409545 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.409503    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-certificates\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.409646 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.409539    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94c76993-536e-4925-990b-8244b58c8879-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xz7jg\" (UID: \"94c76993-536e-4925-990b-8244b58c8879\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg"
Sep 15 09:14:30.409646 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.409579    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjqv8\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-kube-api-access-pjqv8\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.409737 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.409725    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19bd1cc7-62fa-4d3e-b603-90af4ec6d509-config\") pod \"console-operator-696884fb9c-t9m6q\" (UID: \"19bd1cc7-62fa-4d3e-b603-90af4ec6d509\") " pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:14:30.412593 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.412570    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 09:14:30.412687 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.412598    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 09:14:30.412844 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.412824    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-db2z5\""
Sep 15 09:14:30.412917 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.412889    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 15 09:14:30.412971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.412837    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 15 09:14:30.416809 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.416790    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 15 09:14:30.425915 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.425774    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f7c5568d-ngfrs"]
Sep 15 09:14:30.426067 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.426045    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d44h8"
Sep 15 09:14:30.428630 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.428611    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 09:14:30.428737 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.428616    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 09:14:30.428904 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.428889    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 09:14:30.429095 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.429079    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wcvd7\""
Sep 15 09:14:30.445876 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.445817    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz"]
Sep 15 09:14:30.445969 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.445958    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f7c5568d-ngfrs"
Sep 15 09:14:30.448835 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.448817    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 15 09:14:30.448924 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.448856    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 15 09:14:30.448924 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.448856    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 15 09:14:30.449653 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.449632    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-drtdl\""
Sep 15 09:14:30.449753 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.449670    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 15 09:14:30.462216 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.462193    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5995ff59fb-4rbww"]
Sep 15 09:14:30.462328 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.462310    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz"
Sep 15 09:14:30.464450 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.464431    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 15 09:14:30.478352 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.478336    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg"]
Sep 15 09:14:30.478452 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.478366    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-m42w5"]
Sep 15 09:14:30.478514 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.478453    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:30.478973 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.478950    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:30.481133 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.481114    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 15 09:14:30.481133 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.481130    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 15 09:14:30.481437 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.481419    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 09:14:30.481516 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.481456    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 15 09:14:30.481567 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.481514    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 15 09:14:30.482094 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.481934    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fjhv9\""
Sep 15 09:14:30.482094 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.481998    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 09:14:30.496943 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.496922    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"]
Sep 15 09:14:30.497049 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.497009    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-m42w5"
Sep 15 09:14:30.499489 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.499467    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 09:14:30.499595 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.499505    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 09:14:30.499683 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.499666    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-r6j78\""
Sep 15 09:14:30.508642 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.508624    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw"]
Sep 15 09:14:30.508721 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.508665    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-t9m6q"]
Sep 15 09:14:30.508721 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.508687    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"]
Sep 15 09:14:30.508721 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.508707    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zntgf"]
Sep 15 09:14:30.508864 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.508730    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-2wvs2"]
Sep 15 09:14:30.508864 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.508743    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.508864 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.508748    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb"]
Sep 15 09:14:30.509000 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.508877    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz"]
Sep 15 09:14:30.509000 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.508898    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d44h8"]
Sep 15 09:14:30.509000 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.508916    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f7c5568d-ngfrs"]
Sep 15 09:14:30.509000 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.508929    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5995ff59fb-4rbww"]
Sep 15 09:14:30.509000 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.508948    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-m42w5"]
Sep 15 09:14:30.509000 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.508969    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"]
Sep 15 09:14:30.510411 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510377    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/00e2f7b7-6323-4c32-abe4-5405e244cf0c-snapshots\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.510511 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510416    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1433d91-fffc-49fe-b0e7-0ec14fa27689-installation-pull-secrets\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.510511 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510444    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-bound-sa-token\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.510511 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510488    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00e2f7b7-6323-4c32-abe4-5405e244cf0c-serving-cert\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.510667 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510513    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/187ce716-9a59-4735-9a96-7ee6e614f78e-config\") pod \"service-ca-operator-cf7c776b7-fj8rw\" (UID: \"187ce716-9a59-4735-9a96-7ee6e614f78e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw"
Sep 15 09:14:30.510667 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510536    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e2f7b7-6323-4c32-abe4-5405e244cf0c-service-ca-bundle\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.510667 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510559    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15eafc79-a1c2-4649-93d1-8fcc4297f3b6-cert\") pod \"ingress-canary-d44h8\" (UID: \"15eafc79-a1c2-4649-93d1-8fcc4297f3b6\") " pod="openshift-ingress-canary/ingress-canary-d44h8"
Sep 15 09:14:30.510667 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510602    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19bd1cc7-62fa-4d3e-b603-90af4ec6d509-serving-cert\") pod \"console-operator-696884fb9c-t9m6q\" (UID: \"19bd1cc7-62fa-4d3e-b603-90af4ec6d509\") " pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:14:30.510667 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510627    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vjq2\" (UniqueName: \"kubernetes.io/projected/19bd1cc7-62fa-4d3e-b603-90af4ec6d509-kube-api-access-8vjq2\") pod \"console-operator-696884fb9c-t9m6q\" (UID: \"19bd1cc7-62fa-4d3e-b603-90af4ec6d509\") " pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:14:30.510667 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510651    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7cn5\" (UniqueName: \"kubernetes.io/projected/00e2f7b7-6323-4c32-abe4-5405e244cf0c-kube-api-access-g7cn5\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.510971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510679    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/067feeac-5425-4c11-b58a-5d2f8cf37015-config-volume\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:14:30.510971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510703    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:14:30.510971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510730    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/067feeac-5425-4c11-b58a-5d2f8cf37015-tmp-dir\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:14:30.510971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510755    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhq8s\" (UniqueName: \"kubernetes.io/projected/067feeac-5425-4c11-b58a-5d2f8cf37015-kube-api-access-vhq8s\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:14:30.510971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510850    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1433d91-fffc-49fe-b0e7-0ec14fa27689-ca-trust-extracted\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.510971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510887    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19bd1cc7-62fa-4d3e-b603-90af4ec6d509-trusted-ca\") pod \"console-operator-696884fb9c-t9m6q\" (UID: \"19bd1cc7-62fa-4d3e-b603-90af4ec6d509\") " pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:14:30.510971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510919    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqgsk\" (UniqueName: \"kubernetes.io/projected/f495280a-a90e-4da0-9651-85113acabb38-kube-api-access-pqgsk\") pod \"cluster-samples-operator-86499c89c4-ctxmb\" (UID: \"f495280a-a90e-4da0-9651-85113acabb38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb"
Sep 15 09:14:30.510971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510944    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e2f7b7-6323-4c32-abe4-5405e244cf0c-trusted-ca-bundle\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.510971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510967    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1433d91-fffc-49fe-b0e7-0ec14fa27689-trusted-ca\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.511388 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.510995    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-d7dcd\" (UID: \"dbfb9779-5ab4-48b3-957f-7f0f503aa28e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:14:30.511388 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.511024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.511388 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.511058    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9qnf\" (UniqueName: \"kubernetes.io/projected/94c76993-536e-4925-990b-8244b58c8879-kube-api-access-t9qnf\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xz7jg\" (UID: \"94c76993-536e-4925-990b-8244b58c8879\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg"
Sep 15 09:14:30.511388 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.511094    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf4zm\" (UniqueName: \"kubernetes.io/projected/15eafc79-a1c2-4649-93d1-8fcc4297f3b6-kube-api-access-pf4zm\") pod \"ingress-canary-d44h8\" (UID: \"15eafc79-a1c2-4649-93d1-8fcc4297f3b6\") " pod="openshift-ingress-canary/ingress-canary-d44h8"
Sep 15 09:14:30.511388 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:30.511105    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 09:14:30.511388 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:30.511117    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56ff45949-wvktt: secret "image-registry-tls" not found
Sep 15 09:14:30.511388 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.511127    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1433d91-fffc-49fe-b0e7-0ec14fa27689-image-registry-private-configuration\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.511388 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:30.511168    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls podName:f1433d91-fffc-49fe-b0e7-0ec14fa27689 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:31.011148953 +0000 UTC m=+34.660565038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls") pod "image-registry-56ff45949-wvktt" (UID: "f1433d91-fffc-49fe-b0e7-0ec14fa27689") : secret "image-registry-tls" not found
Sep 15 09:14:30.511388 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.511181    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 15 09:14:30.511388 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.511351    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 15 09:14:30.511885 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.511186    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/187ce716-9a59-4735-9a96-7ee6e614f78e-serving-cert\") pod \"service-ca-operator-cf7c776b7-fj8rw\" (UID: \"187ce716-9a59-4735-9a96-7ee6e614f78e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw"
Sep 15 09:14:30.511885 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.511551    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1433d91-fffc-49fe-b0e7-0ec14fa27689-ca-trust-extracted\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.511885 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.511566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtzbk\" (UniqueName: \"kubernetes.io/projected/8762be19-3c51-4ef7-8df4-ee06993466ad-kube-api-access-dtzbk\") pod \"volume-data-source-validator-86695b7cc7-6r9pn\" (UID: \"8762be19-3c51-4ef7-8df4-ee06993466ad\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6r9pn"
Sep 15 09:14:30.511885 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.511623    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ctxmb\" (UID: \"f495280a-a90e-4da0-9651-85113acabb38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb"
Sep 15 09:14:30.511885 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.511676    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 15 09:14:30.512134 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:30.511947    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 09:14:30.512134 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:30.511992    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls podName:f495280a-a90e-4da0-9651-85113acabb38 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:31.011975834 +0000 UTC m=+34.661391919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-ctxmb" (UID: "f495280a-a90e-4da0-9651-85113acabb38") : secret "samples-operator-tls" not found
Sep 15 09:14:30.512134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.512036    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-d7dcd\" (UID: \"dbfb9779-5ab4-48b3-957f-7f0f503aa28e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:14:30.512134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.512069    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzg5v\" (UniqueName: \"kubernetes.io/projected/187ce716-9a59-4735-9a96-7ee6e614f78e-kube-api-access-fzg5v\") pod \"service-ca-operator-cf7c776b7-fj8rw\" (UID: \"187ce716-9a59-4735-9a96-7ee6e614f78e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw"
Sep 15 09:14:30.512134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.512098    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs\") pod \"network-metrics-daemon-2jd2s\" (UID: \"05297e11-2660-4980-a495-baccd89ae99f\") " pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:30.512349 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.512147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-certificates\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.512349 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.512168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94c76993-536e-4925-990b-8244b58c8879-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xz7jg\" (UID: \"94c76993-536e-4925-990b-8244b58c8879\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg"
Sep 15 09:14:30.512349 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.512185    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 15 09:14:30.512349 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:30.512227    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:30.512349 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:30.512259    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs podName:05297e11-2660-4980-a495-baccd89ae99f nodeName:}" failed. No retries permitted until 2026-09-15 09:15:02.51224897 +0000 UTC m=+66.161665040 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs") pod "network-metrics-daemon-2jd2s" (UID: "05297e11-2660-4980-a495-baccd89ae99f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:30.512919 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.512900    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1433d91-fffc-49fe-b0e7-0ec14fa27689-trusted-ca\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.513060 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.513038    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19bd1cc7-62fa-4d3e-b603-90af4ec6d509-trusted-ca\") pod \"console-operator-696884fb9c-t9m6q\" (UID: \"19bd1cc7-62fa-4d3e-b603-90af4ec6d509\") " pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:14:30.513115 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.513104    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjqv8\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-kube-api-access-pjqv8\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.513163 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.513136    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19bd1cc7-62fa-4d3e-b603-90af4ec6d509-config\") pod \"console-operator-696884fb9c-t9m6q\" (UID: \"19bd1cc7-62fa-4d3e-b603-90af4ec6d509\") " pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:14:30.513363 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.513300    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-certificates\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.515516 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.514176    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19bd1cc7-62fa-4d3e-b603-90af4ec6d509-config\") pod \"console-operator-696884fb9c-t9m6q\" (UID: \"19bd1cc7-62fa-4d3e-b603-90af4ec6d509\") " pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:14:30.515516 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.514315    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2k8k\" (UniqueName: \"kubernetes.io/projected/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-kube-api-access-n2k8k\") pod \"cluster-monitoring-operator-6cd954b897-d7dcd\" (UID: \"dbfb9779-5ab4-48b3-957f-7f0f503aa28e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:14:30.515516 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.514369    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00e2f7b7-6323-4c32-abe4-5405e244cf0c-tmp\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.515516 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.514456    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94c76993-536e-4925-990b-8244b58c8879-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xz7jg\" (UID: \"94c76993-536e-4925-990b-8244b58c8879\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg"
Sep 15 09:14:30.515516 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.514979    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94c76993-536e-4925-990b-8244b58c8879-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xz7jg\" (UID: \"94c76993-536e-4925-990b-8244b58c8879\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg"
Sep 15 09:14:30.516124 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.516079    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19bd1cc7-62fa-4d3e-b603-90af4ec6d509-serving-cert\") pod \"console-operator-696884fb9c-t9m6q\" (UID: \"19bd1cc7-62fa-4d3e-b603-90af4ec6d509\") " pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:14:30.516124 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.516090    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1433d91-fffc-49fe-b0e7-0ec14fa27689-image-registry-private-configuration\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.516265 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.516141    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94c76993-536e-4925-990b-8244b58c8879-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xz7jg\" (UID: \"94c76993-536e-4925-990b-8244b58c8879\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg"
Sep 15 09:14:30.516265 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.516180    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1433d91-fffc-49fe-b0e7-0ec14fa27689-installation-pull-secrets\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.519078 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.519059    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-bound-sa-token\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.519842 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.519820    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vjq2\" (UniqueName: \"kubernetes.io/projected/19bd1cc7-62fa-4d3e-b603-90af4ec6d509-kube-api-access-8vjq2\") pod \"console-operator-696884fb9c-t9m6q\" (UID: \"19bd1cc7-62fa-4d3e-b603-90af4ec6d509\") " pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:14:30.523046 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.523023    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqgsk\" (UniqueName: \"kubernetes.io/projected/f495280a-a90e-4da0-9651-85113acabb38-kube-api-access-pqgsk\") pod \"cluster-samples-operator-86499c89c4-ctxmb\" (UID: \"f495280a-a90e-4da0-9651-85113acabb38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb"
Sep 15 09:14:30.523449 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.523390    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9qnf\" (UniqueName: \"kubernetes.io/projected/94c76993-536e-4925-990b-8244b58c8879-kube-api-access-t9qnf\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xz7jg\" (UID: \"94c76993-536e-4925-990b-8244b58c8879\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg"
Sep 15 09:14:30.523563 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.523535    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtzbk\" (UniqueName: \"kubernetes.io/projected/8762be19-3c51-4ef7-8df4-ee06993466ad-kube-api-access-dtzbk\") pod \"volume-data-source-validator-86695b7cc7-6r9pn\" (UID: \"8762be19-3c51-4ef7-8df4-ee06993466ad\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6r9pn"
Sep 15 09:14:30.528729 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.528705    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjqv8\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-kube-api-access-pjqv8\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:30.588821 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.588788    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6r9pn"
Sep 15 09:14:30.608967 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.608946    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg"
Sep 15 09:14:30.616342 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616312    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-d7dcd\" (UID: \"dbfb9779-5ab4-48b3-957f-7f0f503aa28e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:14:30.616457 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616359    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzg5v\" (UniqueName: \"kubernetes.io/projected/187ce716-9a59-4735-9a96-7ee6e614f78e-kube-api-access-fzg5v\") pod \"service-ca-operator-cf7c776b7-fj8rw\" (UID: \"187ce716-9a59-4735-9a96-7ee6e614f78e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw"
Sep 15 09:14:30.616457 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616412    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2k8k\" (UniqueName: \"kubernetes.io/projected/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-kube-api-access-n2k8k\") pod \"cluster-monitoring-operator-6cd954b897-d7dcd\" (UID: \"dbfb9779-5ab4-48b3-957f-7f0f503aa28e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:14:30.616457 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616439    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00e2f7b7-6323-4c32-abe4-5405e244cf0c-tmp\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.616590 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:30.616455    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 09:14:30.616590 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616471    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/274f31e2-bcdb-4c89-be9a-228dc2716890-klusterlet-config\") pod \"klusterlet-addon-workmgr-59ccf45976-2qpxz\" (UID: \"274f31e2-bcdb-4c89-be9a-228dc2716890\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz"
Sep 15 09:14:30.616590 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616503    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:30.616590 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:30.616529    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls podName:dbfb9779-5ab4-48b3-957f-7f0f503aa28e nodeName:}" failed. No retries permitted until 2026-09-15 09:14:31.116511272 +0000 UTC m=+34.765927348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-d7dcd" (UID: "dbfb9779-5ab4-48b3-957f-7f0f503aa28e") : secret "cluster-monitoring-operator-tls" not found
Sep 15 09:14:30.616749 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616647    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24h29\" (UniqueName: \"kubernetes.io/projected/00db89bc-2f90-477a-9649-cefe1877671c-kube-api-access-24h29\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.616749 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616674    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/00e2f7b7-6323-4c32-abe4-5405e244cf0c-snapshots\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.616749 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616705    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/00db89bc-2f90-477a-9649-cefe1877671c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.616749 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616730    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret\") pod \"global-pull-secret-syncer-rwg82\" (UID: \"12d964ec-1ded-49e8-bd7c-18c450406339\") " pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:30.616749 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616745    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00e2f7b7-6323-4c32-abe4-5405e244cf0c-serving-cert\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.616970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616811    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/00db89bc-2f90-477a-9649-cefe1877671c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.616970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616880    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/187ce716-9a59-4735-9a96-7ee6e614f78e-config\") pod \"service-ca-operator-cf7c776b7-fj8rw\" (UID: \"187ce716-9a59-4735-9a96-7ee6e614f78e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw"
Sep 15 09:14:30.616970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616896    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e2f7b7-6323-4c32-abe4-5405e244cf0c-service-ca-bundle\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.616970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616918    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15eafc79-a1c2-4649-93d1-8fcc4297f3b6-cert\") pod \"ingress-canary-d44h8\" (UID: \"15eafc79-a1c2-4649-93d1-8fcc4297f3b6\") " pod="openshift-ingress-canary/ingress-canary-d44h8"
Sep 15 09:14:30.616970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616935    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/00db89bc-2f90-477a-9649-cefe1877671c-hub\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.616970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616952    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddjzm\" (UniqueName: \"kubernetes.io/projected/6e02c47f-25b4-4d5d-b16b-eec4eb0f4172-kube-api-access-ddjzm\") pod \"managed-serviceaccount-addon-agent-78f7c5568d-ngfrs\" (UID: \"6e02c47f-25b4-4d5d-b16b-eec4eb0f4172\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f7c5568d-ngfrs"
Sep 15 09:14:30.616970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.616971    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zxt7\" (UniqueName: \"kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7\") pod \"network-check-target-mcckq\" (UID: \"6b4c7605-a586-49d3-9cd7-b0d0502947aa\") " pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:30.617235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7cn5\" (UniqueName: \"kubernetes.io/projected/00e2f7b7-6323-4c32-abe4-5405e244cf0c-kube-api-access-g7cn5\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.617235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/067feeac-5425-4c11-b58a-5d2f8cf37015-config-volume\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:14:30.617235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617059    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:14:30.617235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617057    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00e2f7b7-6323-4c32-abe4-5405e244cf0c-tmp\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.617235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617076    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/00db89bc-2f90-477a-9649-cefe1877671c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.617235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617101    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/067feeac-5425-4c11-b58a-5d2f8cf37015-tmp-dir\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:14:30.617235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhq8s\" (UniqueName: \"kubernetes.io/projected/067feeac-5425-4c11-b58a-5d2f8cf37015-kube-api-access-vhq8s\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:14:30.617235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69kf8\" (UniqueName: \"kubernetes.io/projected/274f31e2-bcdb-4c89-be9a-228dc2716890-kube-api-access-69kf8\") pod \"klusterlet-addon-workmgr-59ccf45976-2qpxz\" (UID: \"274f31e2-bcdb-4c89-be9a-228dc2716890\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz"
Sep 15 09:14:30.617235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617155    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2nvd\" (UniqueName: \"kubernetes.io/projected/49237773-7a17-4886-b757-650adf21b082-kube-api-access-v2nvd\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:30.617235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617179    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/00db89bc-2f90-477a-9649-cefe1877671c-ca\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.617235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617204    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e02c47f-25b4-4d5d-b16b-eec4eb0f4172-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78f7c5568d-ngfrs\" (UID: \"6e02c47f-25b4-4d5d-b16b-eec4eb0f4172\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f7c5568d-ngfrs"
Sep 15 09:14:30.617235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617234    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e2f7b7-6323-4c32-abe4-5405e244cf0c-trusted-ca-bundle\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.617871 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617263    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/274f31e2-bcdb-4c89-be9a-228dc2716890-tmp\") pod \"klusterlet-addon-workmgr-59ccf45976-2qpxz\" (UID: \"274f31e2-bcdb-4c89-be9a-228dc2716890\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz"
Sep 15 09:14:30.617871 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-d7dcd\" (UID: \"dbfb9779-5ab4-48b3-957f-7f0f503aa28e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:14:30.617871 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617311    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-stats-auth\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:30.617871 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617344    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/00e2f7b7-6323-4c32-abe4-5405e244cf0c-snapshots\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.617871 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617352    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf4zm\" (UniqueName: \"kubernetes.io/projected/15eafc79-a1c2-4649-93d1-8fcc4297f3b6-kube-api-access-pf4zm\") pod \"ingress-canary-d44h8\" (UID: \"15eafc79-a1c2-4649-93d1-8fcc4297f3b6\") " pod="openshift-ingress-canary/ingress-canary-d44h8"
Sep 15 09:14:30.617871 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617400    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-default-certificate\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:30.617871 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:30.617871 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617462    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2pxx\" (UniqueName: \"kubernetes.io/projected/da8b4d1e-c64f-4da2-b691-bd2d28213158-kube-api-access-d2pxx\") pod \"network-check-source-6f8b768455-m42w5\" (UID: \"da8b4d1e-c64f-4da2-b691-bd2d28213158\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-m42w5"
Sep 15 09:14:30.617871 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/187ce716-9a59-4735-9a96-7ee6e614f78e-serving-cert\") pod \"service-ca-operator-cf7c776b7-fj8rw\" (UID: \"187ce716-9a59-4735-9a96-7ee6e614f78e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw"
Sep 15 09:14:30.617871 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617529    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/187ce716-9a59-4735-9a96-7ee6e614f78e-config\") pod \"service-ca-operator-cf7c776b7-fj8rw\" (UID: \"187ce716-9a59-4735-9a96-7ee6e614f78e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw"
Sep 15 09:14:30.617871 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:30.617698    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:30.617871 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:30.617749    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret podName:12d964ec-1ded-49e8-bd7c-18c450406339 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:02.617732906 +0000 UTC m=+66.267148978 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret") pod "global-pull-secret-syncer-rwg82" (UID: "12d964ec-1ded-49e8-bd7c-18c450406339") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:30.618607 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.617922    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/067feeac-5425-4c11-b58a-5d2f8cf37015-tmp-dir\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:14:30.618607 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.618288    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e2f7b7-6323-4c32-abe4-5405e244cf0c-service-ca-bundle\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.618607 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.618367    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/067feeac-5425-4c11-b58a-5d2f8cf37015-config-volume\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:14:30.618607 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:30.618448    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:14:30.618607 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:30.618491    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls podName:067feeac-5425-4c11-b58a-5d2f8cf37015 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:31.11847654 +0000 UTC m=+34.767892614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls") pod "dns-default-zntgf" (UID: "067feeac-5425-4c11-b58a-5d2f8cf37015") : secret "dns-default-metrics-tls" not found
Sep 15 09:14:30.618607 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.618505    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-d7dcd\" (UID: \"dbfb9779-5ab4-48b3-957f-7f0f503aa28e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:14:30.619225 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.619190    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e2f7b7-6323-4c32-abe4-5405e244cf0c-trusted-ca-bundle\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.620352 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.620325    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/187ce716-9a59-4735-9a96-7ee6e614f78e-serving-cert\") pod \"service-ca-operator-cf7c776b7-fj8rw\" (UID: \"187ce716-9a59-4735-9a96-7ee6e614f78e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw"
Sep 15 09:14:30.621254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.621229    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00e2f7b7-6323-4c32-abe4-5405e244cf0c-serving-cert\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.621456 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.621423    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zxt7\" (UniqueName: \"kubernetes.io/projected/6b4c7605-a586-49d3-9cd7-b0d0502947aa-kube-api-access-5zxt7\") pod \"network-check-target-mcckq\" (UID: \"6b4c7605-a586-49d3-9cd7-b0d0502947aa\") " pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:30.621557 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.621489    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15eafc79-a1c2-4649-93d1-8fcc4297f3b6-cert\") pod \"ingress-canary-d44h8\" (UID: \"15eafc79-a1c2-4649-93d1-8fcc4297f3b6\") " pod="openshift-ingress-canary/ingress-canary-d44h8"
Sep 15 09:14:30.625629 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.625609    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzg5v\" (UniqueName: \"kubernetes.io/projected/187ce716-9a59-4735-9a96-7ee6e614f78e-kube-api-access-fzg5v\") pod \"service-ca-operator-cf7c776b7-fj8rw\" (UID: \"187ce716-9a59-4735-9a96-7ee6e614f78e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw"
Sep 15 09:14:30.626040 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.626014    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2k8k\" (UniqueName: \"kubernetes.io/projected/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-kube-api-access-n2k8k\") pod \"cluster-monitoring-operator-6cd954b897-d7dcd\" (UID: \"dbfb9779-5ab4-48b3-957f-7f0f503aa28e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:14:30.626340 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.626316    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf4zm\" (UniqueName: \"kubernetes.io/projected/15eafc79-a1c2-4649-93d1-8fcc4297f3b6-kube-api-access-pf4zm\") pod \"ingress-canary-d44h8\" (UID: \"15eafc79-a1c2-4649-93d1-8fcc4297f3b6\") " pod="openshift-ingress-canary/ingress-canary-d44h8"
Sep 15 09:14:30.627003 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.626981    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7cn5\" (UniqueName: \"kubernetes.io/projected/00e2f7b7-6323-4c32-abe4-5405e244cf0c-kube-api-access-g7cn5\") pod \"insights-operator-5844b856db-2wvs2\" (UID: \"00e2f7b7-6323-4c32-abe4-5405e244cf0c\") " pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.627535 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.627493    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhq8s\" (UniqueName: \"kubernetes.io/projected/067feeac-5425-4c11-b58a-5d2f8cf37015-kube-api-access-vhq8s\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:14:30.628280 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.628263    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:14:30.684120 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.684090    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:30.700122 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.700063    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw"
Sep 15 09:14:30.718136 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.718112    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/00db89bc-2f90-477a-9649-cefe1877671c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.718248 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.718153    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69kf8\" (UniqueName: \"kubernetes.io/projected/274f31e2-bcdb-4c89-be9a-228dc2716890-kube-api-access-69kf8\") pod \"klusterlet-addon-workmgr-59ccf45976-2qpxz\" (UID: \"274f31e2-bcdb-4c89-be9a-228dc2716890\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz"
Sep 15 09:14:30.718248 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.718188    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2nvd\" (UniqueName: \"kubernetes.io/projected/49237773-7a17-4886-b757-650adf21b082-kube-api-access-v2nvd\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:30.718248 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.718211    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/00db89bc-2f90-477a-9649-cefe1877671c-ca\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.718248 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.718233    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e02c47f-25b4-4d5d-b16b-eec4eb0f4172-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78f7c5568d-ngfrs\" (UID: \"6e02c47f-25b4-4d5d-b16b-eec4eb0f4172\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f7c5568d-ngfrs"
Sep 15 09:14:30.718453 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.718262    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/274f31e2-bcdb-4c89-be9a-228dc2716890-tmp\") pod \"klusterlet-addon-workmgr-59ccf45976-2qpxz\" (UID: \"274f31e2-bcdb-4c89-be9a-228dc2716890\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz"
Sep 15 09:14:30.718453 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.718290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-stats-auth\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:30.718453 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.718332    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-default-certificate\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:30.718453 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.718359    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:30.718453 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.718384    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2pxx\" (UniqueName: \"kubernetes.io/projected/da8b4d1e-c64f-4da2-b691-bd2d28213158-kube-api-access-d2pxx\") pod \"network-check-source-6f8b768455-m42w5\" (UID: \"da8b4d1e-c64f-4da2-b691-bd2d28213158\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-m42w5"
Sep 15 09:14:30.718682 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.718464    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/274f31e2-bcdb-4c89-be9a-228dc2716890-klusterlet-config\") pod \"klusterlet-addon-workmgr-59ccf45976-2qpxz\" (UID: \"274f31e2-bcdb-4c89-be9a-228dc2716890\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz"
Sep 15 09:14:30.718682 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.718499    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:30.718682 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.718523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24h29\" (UniqueName: \"kubernetes.io/projected/00db89bc-2f90-477a-9649-cefe1877671c-kube-api-access-24h29\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.718682 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:30.718581    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 09:14:30.718906 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:30.718699    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs podName:49237773-7a17-4886-b757-650adf21b082 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:31.218678464 +0000 UTC m=+34.868094554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs") pod "router-default-5995ff59fb-4rbww" (UID: "49237773-7a17-4886-b757-650adf21b082") : secret "router-metrics-certs-default" not found
Sep 15 09:14:30.719986 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.719091    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/274f31e2-bcdb-4c89-be9a-228dc2716890-tmp\") pod \"klusterlet-addon-workmgr-59ccf45976-2qpxz\" (UID: \"274f31e2-bcdb-4c89-be9a-228dc2716890\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz"
Sep 15 09:14:30.719986 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:30.719289    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle podName:49237773-7a17-4886-b757-650adf21b082 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:31.21927184 +0000 UTC m=+34.868687937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle") pod "router-default-5995ff59fb-4rbww" (UID: "49237773-7a17-4886-b757-650adf21b082") : configmap references non-existent config key: service-ca.crt
Sep 15 09:14:30.719986 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.719322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/00db89bc-2f90-477a-9649-cefe1877671c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.719986 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.719381    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/00db89bc-2f90-477a-9649-cefe1877671c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.719986 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.719415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/00db89bc-2f90-477a-9649-cefe1877671c-hub\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.719986 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.719441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddjzm\" (UniqueName: \"kubernetes.io/projected/6e02c47f-25b4-4d5d-b16b-eec4eb0f4172-kube-api-access-ddjzm\") pod \"managed-serviceaccount-addon-agent-78f7c5568d-ngfrs\" (UID: \"6e02c47f-25b4-4d5d-b16b-eec4eb0f4172\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f7c5568d-ngfrs"
Sep 15 09:14:30.720356 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.720190    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/00db89bc-2f90-477a-9649-cefe1877671c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.720997 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.720974    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-2wvs2"
Sep 15 09:14:30.721746 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.721712    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/00db89bc-2f90-477a-9649-cefe1877671c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.721897 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.721853    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e02c47f-25b4-4d5d-b16b-eec4eb0f4172-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78f7c5568d-ngfrs\" (UID: \"6e02c47f-25b4-4d5d-b16b-eec4eb0f4172\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f7c5568d-ngfrs"
Sep 15 09:14:30.722997 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.722579    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-stats-auth\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:30.722997 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.722604    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-default-certificate\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:30.722997 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.722662    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/274f31e2-bcdb-4c89-be9a-228dc2716890-klusterlet-config\") pod \"klusterlet-addon-workmgr-59ccf45976-2qpxz\" (UID: \"274f31e2-bcdb-4c89-be9a-228dc2716890\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz"
Sep 15 09:14:30.722997 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.722958    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/00db89bc-2f90-477a-9649-cefe1877671c-ca\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.722997 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.722970    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/00db89bc-2f90-477a-9649-cefe1877671c-hub\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.723926 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.723908    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/00db89bc-2f90-477a-9649-cefe1877671c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.726936 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.726902    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69kf8\" (UniqueName: \"kubernetes.io/projected/274f31e2-bcdb-4c89-be9a-228dc2716890-kube-api-access-69kf8\") pod \"klusterlet-addon-workmgr-59ccf45976-2qpxz\" (UID: \"274f31e2-bcdb-4c89-be9a-228dc2716890\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz"
Sep 15 09:14:30.727581 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.727554    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2pxx\" (UniqueName: \"kubernetes.io/projected/da8b4d1e-c64f-4da2-b691-bd2d28213158-kube-api-access-d2pxx\") pod \"network-check-source-6f8b768455-m42w5\" (UID: \"da8b4d1e-c64f-4da2-b691-bd2d28213158\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-m42w5"
Sep 15 09:14:30.727685 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.727655    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2nvd\" (UniqueName: \"kubernetes.io/projected/49237773-7a17-4886-b757-650adf21b082-kube-api-access-v2nvd\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:30.728313 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.728281    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddjzm\" (UniqueName: \"kubernetes.io/projected/6e02c47f-25b4-4d5d-b16b-eec4eb0f4172-kube-api-access-ddjzm\") pod \"managed-serviceaccount-addon-agent-78f7c5568d-ngfrs\" (UID: \"6e02c47f-25b4-4d5d-b16b-eec4eb0f4172\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f7c5568d-ngfrs"
Sep 15 09:14:30.729082 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.729064    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24h29\" (UniqueName: \"kubernetes.io/projected/00db89bc-2f90-477a-9649-cefe1877671c-kube-api-access-24h29\") pod \"cluster-proxy-proxy-agent-8696f4c749-5x5vh\" (UID: \"00db89bc-2f90-477a-9649-cefe1877671c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.735861 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.735845    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d44h8"
Sep 15 09:14:30.765822 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.765795    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f7c5568d-ngfrs"
Sep 15 09:14:30.773572 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.773556    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz"
Sep 15 09:14:30.784518 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.784490    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:30.808001 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.807975    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-m42w5"
Sep 15 09:14:30.842964 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.842932    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:14:30.853231 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.853207    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:30.853231 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.853219    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:14:30.853375 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.853364    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:14:30.856062 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.856042    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 09:14:30.856239 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.856220    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ddxwx\""
Sep 15 09:14:30.856315 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.856237    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 09:14:30.856315 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.856225    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6rrz2\""
Sep 15 09:14:30.877333 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:30.877318    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:31.022898 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:31.022553    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:31.022898 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:31.022624    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ctxmb\" (UID: \"f495280a-a90e-4da0-9651-85113acabb38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb"
Sep 15 09:14:31.022898 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:31.022660    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 09:14:31.022898 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:31.022683    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56ff45949-wvktt: secret "image-registry-tls" not found
Sep 15 09:14:31.022898 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:31.022726    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 09:14:31.022898 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:31.022758    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls podName:f1433d91-fffc-49fe-b0e7-0ec14fa27689 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:32.022732919 +0000 UTC m=+35.672149009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls") pod "image-registry-56ff45949-wvktt" (UID: "f1433d91-fffc-49fe-b0e7-0ec14fa27689") : secret "image-registry-tls" not found
Sep 15 09:14:31.022898 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:31.022811    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls podName:f495280a-a90e-4da0-9651-85113acabb38 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:32.022793437 +0000 UTC m=+35.672209509 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-ctxmb" (UID: "f495280a-a90e-4da0-9651-85113acabb38") : secret "samples-operator-tls" not found
Sep 15 09:14:31.124125 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:31.124090    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-d7dcd\" (UID: \"dbfb9779-5ab4-48b3-957f-7f0f503aa28e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:14:31.124320 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:31.124214    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:14:31.124320 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:31.124288    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 09:14:31.124434 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:31.124334    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:14:31.124434 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:31.124375    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls podName:dbfb9779-5ab4-48b3-957f-7f0f503aa28e nodeName:}" failed. No retries permitted until 2026-09-15 09:14:32.124352917 +0000 UTC m=+35.773768991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-d7dcd" (UID: "dbfb9779-5ab4-48b3-957f-7f0f503aa28e") : secret "cluster-monitoring-operator-tls" not found
Sep 15 09:14:31.124434 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:31.124396    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls podName:067feeac-5425-4c11-b58a-5d2f8cf37015 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:32.124385009 +0000 UTC m=+35.773801082 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls") pod "dns-default-zntgf" (UID: "067feeac-5425-4c11-b58a-5d2f8cf37015") : secret "dns-default-metrics-tls" not found
Sep 15 09:14:31.225475 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:31.225440    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:31.225965 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:31.225532    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:31.225965 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:31.225596    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 09:14:31.225965 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:31.225661    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs podName:49237773-7a17-4886-b757-650adf21b082 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:32.225644616 +0000 UTC m=+35.875060707 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs") pod "router-default-5995ff59fb-4rbww" (UID: "49237773-7a17-4886-b757-650adf21b082") : secret "router-metrics-certs-default" not found
Sep 15 09:14:31.225965 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:31.225698    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle podName:49237773-7a17-4886-b757-650adf21b082 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:32.225677127 +0000 UTC m=+35.875093202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle") pod "router-default-5995ff59fb-4rbww" (UID: "49237773-7a17-4886-b757-650adf21b082") : configmap references non-existent config key: service-ca.crt
Sep 15 09:14:31.776598 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:31.776358    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d44h8"]
Sep 15 09:14:31.780164 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:14:31.780062    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15eafc79_a1c2_4649_93d1_8fcc4297f3b6.slice/crio-497264bb8305e317e54aa232a5675699ed202564706263492a0e79da96c1d99a WatchSource:0}: Error finding container 497264bb8305e317e54aa232a5675699ed202564706263492a0e79da96c1d99a: Status 404 returned error can't find the container with id 497264bb8305e317e54aa232a5675699ed202564706263492a0e79da96c1d99a
Sep 15 09:14:31.781041 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:31.780944    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg"]
Sep 15 09:14:31.782399 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:31.782376    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-2wvs2"]
Sep 15 09:14:31.783629 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:31.783607    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-m42w5"]
Sep 15 09:14:31.784827 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:31.784801    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-t9m6q"]
Sep 15 09:14:31.789953 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:14:31.789697    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c76993_536e_4925_990b_8244b58c8879.slice/crio-071b3417d21778f8a99e70f4361d106f5b4b72fe52e04c06cbe73cdb775a53cb WatchSource:0}: Error finding container 071b3417d21778f8a99e70f4361d106f5b4b72fe52e04c06cbe73cdb775a53cb: Status 404 returned error can't find the container with id 071b3417d21778f8a99e70f4361d106f5b4b72fe52e04c06cbe73cdb775a53cb
Sep 15 09:14:31.791118 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:14:31.791078    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19bd1cc7_62fa_4d3e_b603_90af4ec6d509.slice/crio-8d3da98d5708f2b089d8cec08bd3246fd755b8b3a73128cebcd74b6895252bcf WatchSource:0}: Error finding container 8d3da98d5708f2b089d8cec08bd3246fd755b8b3a73128cebcd74b6895252bcf: Status 404 returned error can't find the container with id 8d3da98d5708f2b089d8cec08bd3246fd755b8b3a73128cebcd74b6895252bcf
Sep 15 09:14:31.791928 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:14:31.791908    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda8b4d1e_c64f_4da2_b691_bd2d28213158.slice/crio-f2fc29eec6ec7aad682c7fec88d75d117b218aa68c159c3445a2c799ebf0b67b WatchSource:0}: Error finding container f2fc29eec6ec7aad682c7fec88d75d117b218aa68c159c3445a2c799ebf0b67b: Status 404 returned error can't find the container with id f2fc29eec6ec7aad682c7fec88d75d117b218aa68c159c3445a2c799ebf0b67b
Sep 15 09:14:31.812823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:31.812732    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6r9pn"]
Sep 15 09:14:31.814988 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:14:31.814968    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8762be19_3c51_4ef7_8df4_ee06993466ad.slice/crio-8484dfb66e1bb58d9658a3d43cc710b06465a0a61c1ff0cbafa03a3f467af309 WatchSource:0}: Error finding container 8484dfb66e1bb58d9658a3d43cc710b06465a0a61c1ff0cbafa03a3f467af309: Status 404 returned error can't find the container with id 8484dfb66e1bb58d9658a3d43cc710b06465a0a61c1ff0cbafa03a3f467af309
Sep 15 09:14:31.855787 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:31.855703    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz"]
Sep 15 09:14:31.859778 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:14:31.859706    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274f31e2_bcdb_4c89_be9a_228dc2716890.slice/crio-8de0669230b8d7188777eeaa6a9c7f6def2bdaf062f23c45383db2edc1f00b41 WatchSource:0}: Error finding container 8de0669230b8d7188777eeaa6a9c7f6def2bdaf062f23c45383db2edc1f00b41: Status 404 returned error can't find the container with id 8de0669230b8d7188777eeaa6a9c7f6def2bdaf062f23c45383db2edc1f00b41
Sep 15 09:14:31.862506 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:31.862470    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"]
Sep 15 09:14:31.864447 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:31.864427    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw"]
Sep 15 09:14:31.866946 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:31.866881    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f7c5568d-ngfrs"]
Sep 15 09:14:31.868422 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:31.867584    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mcckq"]
Sep 15 09:14:31.890003 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:14:31.889976    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4c7605_a586_49d3_9cd7_b0d0502947aa.slice/crio-b37e5efa0bf06642d092ae2f08983133b55f5fdd61b2b486e04fbcd126d8637c WatchSource:0}: Error finding container b37e5efa0bf06642d092ae2f08983133b55f5fdd61b2b486e04fbcd126d8637c: Status 404 returned error can't find the container with id b37e5efa0bf06642d092ae2f08983133b55f5fdd61b2b486e04fbcd126d8637c
Sep 15 09:14:31.890590 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:14:31.890557    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00db89bc_2f90_477a_9649_cefe1877671c.slice/crio-68f7b8e68a02a962084ba6c0af8dd6dbb646e17497a4c9dbaccee115f9e55607 WatchSource:0}: Error finding container 68f7b8e68a02a962084ba6c0af8dd6dbb646e17497a4c9dbaccee115f9e55607: Status 404 returned error can't find the container with id 68f7b8e68a02a962084ba6c0af8dd6dbb646e17497a4c9dbaccee115f9e55607
Sep 15 09:14:31.890848 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:14:31.890782    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e02c47f_25b4_4d5d_b16b_eec4eb0f4172.slice/crio-b9e533421ce8558d2f58d265f567c3c24fab4c847ffd295dfa90e1444c3794e3 WatchSource:0}: Error finding container b9e533421ce8558d2f58d265f567c3c24fab4c847ffd295dfa90e1444c3794e3: Status 404 returned error can't find the container with id b9e533421ce8558d2f58d265f567c3c24fab4c847ffd295dfa90e1444c3794e3
Sep 15 09:14:31.891006 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:14:31.890987    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod187ce716_9a59_4735_9a96_7ee6e614f78e.slice/crio-870ae69f9748fcfa96f557f0382395f43d858fb864b05eb8523d7406fa189a58 WatchSource:0}: Error finding container 870ae69f9748fcfa96f557f0382395f43d858fb864b05eb8523d7406fa189a58: Status 404 returned error can't find the container with id 870ae69f9748fcfa96f557f0382395f43d858fb864b05eb8523d7406fa189a58
Sep 15 09:14:31.904744 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:31.904725    2575 kuberuntime_manager.go:1459] "Unhandled Error" err="container service-ca-operator start failed in pod service-ca-operator-cf7c776b7-fj8rw_openshift-service-ca-operator(187ce716-9a59-4735-9a96-7ee6e614f78e): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Sep 15 09:14:31.904842 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:31.904758    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"service-ca-operator\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw" podUID="187ce716-9a59-4735-9a96-7ee6e614f78e"
Sep 15 09:14:32.036725 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.036699    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:32.036889 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.036749    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ctxmb\" (UID: \"f495280a-a90e-4da0-9651-85113acabb38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb"
Sep 15 09:14:32.036889 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:32.036870    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 09:14:32.036889 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:32.036888    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56ff45949-wvktt: secret "image-registry-tls" not found
Sep 15 09:14:32.037004 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:32.036931    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 09:14:32.037004 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:32.036952    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls podName:f1433d91-fffc-49fe-b0e7-0ec14fa27689 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:34.036934485 +0000 UTC m=+37.686350558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls") pod "image-registry-56ff45949-wvktt" (UID: "f1433d91-fffc-49fe-b0e7-0ec14fa27689") : secret "image-registry-tls" not found
Sep 15 09:14:32.037004 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:32.036982    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls podName:f495280a-a90e-4da0-9651-85113acabb38 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:34.036968865 +0000 UTC m=+37.686384935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-ctxmb" (UID: "f495280a-a90e-4da0-9651-85113acabb38") : secret "samples-operator-tls" not found
Sep 15 09:14:32.138296 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.138266    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:14:32.138444 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.138353    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-d7dcd\" (UID: \"dbfb9779-5ab4-48b3-957f-7f0f503aa28e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:14:32.138444 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:32.138409    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:14:32.138529 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:32.138448    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 09:14:32.138529 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:32.138470    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls podName:067feeac-5425-4c11-b58a-5d2f8cf37015 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:34.138454098 +0000 UTC m=+37.787870169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls") pod "dns-default-zntgf" (UID: "067feeac-5425-4c11-b58a-5d2f8cf37015") : secret "dns-default-metrics-tls" not found
Sep 15 09:14:32.138529 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:32.138487    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls podName:dbfb9779-5ab4-48b3-957f-7f0f503aa28e nodeName:}" failed. No retries permitted until 2026-09-15 09:14:34.138476548 +0000 UTC m=+37.787892619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-d7dcd" (UID: "dbfb9779-5ab4-48b3-957f-7f0f503aa28e") : secret "cluster-monitoring-operator-tls" not found
Sep 15 09:14:32.144911 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.144882    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh" event={"ID":"00db89bc-2f90-477a-9649-cefe1877671c","Type":"ContainerStarted","Data":"68f7b8e68a02a962084ba6c0af8dd6dbb646e17497a4c9dbaccee115f9e55607"}
Sep 15 09:14:32.146048 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.146024    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6r9pn" event={"ID":"8762be19-3c51-4ef7-8df4-ee06993466ad","Type":"ContainerStarted","Data":"8484dfb66e1bb58d9658a3d43cc710b06465a0a61c1ff0cbafa03a3f467af309"}
Sep 15 09:14:32.147142 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.147121    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-2wvs2" event={"ID":"00e2f7b7-6323-4c32-abe4-5405e244cf0c","Type":"ContainerStarted","Data":"249fe2c5c33c562885f7c47f097c0eaf842dea12c2a62bbdd007ffa61d320981"}
Sep 15 09:14:32.149993 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.149970    2575 generic.go:356] "Generic (PLEG): container finished" podID="6272a978-5c5f-452a-88c0-91affa1d942c" containerID="0f7790b66f415a6510deaf8fb579dc1d9eb2d3b0e0f78ce9ab0efdccbbf6fd64" exitCode=0
Sep 15 09:14:32.150083 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.150054    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nx8dj" event={"ID":"6272a978-5c5f-452a-88c0-91affa1d942c","Type":"ContainerDied","Data":"0f7790b66f415a6510deaf8fb579dc1d9eb2d3b0e0f78ce9ab0efdccbbf6fd64"}
Sep 15 09:14:32.151202 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.151174    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f7c5568d-ngfrs" event={"ID":"6e02c47f-25b4-4d5d-b16b-eec4eb0f4172","Type":"ContainerStarted","Data":"b9e533421ce8558d2f58d265f567c3c24fab4c847ffd295dfa90e1444c3794e3"}
Sep 15 09:14:32.152330 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.152308    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg" event={"ID":"94c76993-536e-4925-990b-8244b58c8879","Type":"ContainerStarted","Data":"071b3417d21778f8a99e70f4361d106f5b4b72fe52e04c06cbe73cdb775a53cb"}
Sep 15 09:14:32.153424 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.153404    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-t9m6q" event={"ID":"19bd1cc7-62fa-4d3e-b603-90af4ec6d509","Type":"ContainerStarted","Data":"8d3da98d5708f2b089d8cec08bd3246fd755b8b3a73128cebcd74b6895252bcf"}
Sep 15 09:14:32.154462 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.154440    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mcckq" event={"ID":"6b4c7605-a586-49d3-9cd7-b0d0502947aa","Type":"ContainerStarted","Data":"b37e5efa0bf06642d092ae2f08983133b55f5fdd61b2b486e04fbcd126d8637c"}
Sep 15 09:14:32.155623 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.155605    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d44h8" event={"ID":"15eafc79-a1c2-4649-93d1-8fcc4297f3b6","Type":"ContainerStarted","Data":"497264bb8305e317e54aa232a5675699ed202564706263492a0e79da96c1d99a"}
Sep 15 09:14:32.156944 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.156921    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-m42w5" event={"ID":"da8b4d1e-c64f-4da2-b691-bd2d28213158","Type":"ContainerStarted","Data":"f2fc29eec6ec7aad682c7fec88d75d117b218aa68c159c3445a2c799ebf0b67b"}
Sep 15 09:14:32.158116 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.158095    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw" event={"ID":"187ce716-9a59-4735-9a96-7ee6e614f78e","Type":"ContainerStarted","Data":"870ae69f9748fcfa96f557f0382395f43d858fb864b05eb8523d7406fa189a58"}
Sep 15 09:14:32.159167 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.159144    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz" event={"ID":"274f31e2-bcdb-4c89-be9a-228dc2716890","Type":"ContainerStarted","Data":"8de0669230b8d7188777eeaa6a9c7f6def2bdaf062f23c45383db2edc1f00b41"}
Sep 15 09:14:32.159232 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:32.159140    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"service-ca-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8cb29fc1c92700329dd98a3c557daeb24c2014dd6f91dfb7991df28529bfc280\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw" podUID="187ce716-9a59-4735-9a96-7ee6e614f78e"
Sep 15 09:14:32.239742 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.239716    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:32.240412 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:32.239903    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle podName:49237773-7a17-4886-b757-650adf21b082 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:34.239884301 +0000 UTC m=+37.889300372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle") pod "router-default-5995ff59fb-4rbww" (UID: "49237773-7a17-4886-b757-650adf21b082") : configmap references non-existent config key: service-ca.crt
Sep 15 09:14:32.240412 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.239940    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:32.240412 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:32.240077    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 09:14:32.240412 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:32.240131    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs podName:49237773-7a17-4886-b757-650adf21b082 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:34.240113738 +0000 UTC m=+37.889529810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs") pod "router-default-5995ff59fb-4rbww" (UID: "49237773-7a17-4886-b757-650adf21b082") : secret "router-metrics-certs-default" not found
Sep 15 09:14:32.436641 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.436610    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:32.499956 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:32.499919    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:33.237499 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:33.237463    2575 generic.go:356] "Generic (PLEG): container finished" podID="6272a978-5c5f-452a-88c0-91affa1d942c" containerID="4800e9b74901028305cdbb0355f97d1bf10da5beb9eb6d3d42b9cf021dde11cb" exitCode=0
Sep 15 09:14:33.238716 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:33.238679    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nx8dj" event={"ID":"6272a978-5c5f-452a-88c0-91affa1d942c","Type":"ContainerDied","Data":"4800e9b74901028305cdbb0355f97d1bf10da5beb9eb6d3d42b9cf021dde11cb"}
Sep 15 09:14:33.256909 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:33.256845    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"service-ca-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8cb29fc1c92700329dd98a3c557daeb24c2014dd6f91dfb7991df28529bfc280\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw" podUID="187ce716-9a59-4735-9a96-7ee6e614f78e"
Sep 15 09:14:34.061283 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:34.060404    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:34.061283 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:34.060478    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ctxmb\" (UID: \"f495280a-a90e-4da0-9651-85113acabb38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb"
Sep 15 09:14:34.061283 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:34.060642    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 09:14:34.061283 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:34.060720    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls podName:f495280a-a90e-4da0-9651-85113acabb38 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:38.060701227 +0000 UTC m=+41.710117303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-ctxmb" (UID: "f495280a-a90e-4da0-9651-85113acabb38") : secret "samples-operator-tls" not found
Sep 15 09:14:34.061283 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:34.061139    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 09:14:34.061283 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:34.061154    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56ff45949-wvktt: secret "image-registry-tls" not found
Sep 15 09:14:34.061283 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:34.061213    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls podName:f1433d91-fffc-49fe-b0e7-0ec14fa27689 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:38.06118598 +0000 UTC m=+41.710602052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls") pod "image-registry-56ff45949-wvktt" (UID: "f1433d91-fffc-49fe-b0e7-0ec14fa27689") : secret "image-registry-tls" not found
Sep 15 09:14:34.128102 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:34.126035    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:34.161985 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:34.161112    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:14:34.161985 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:34.161235    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-d7dcd\" (UID: \"dbfb9779-5ab4-48b3-957f-7f0f503aa28e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:14:34.161985 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:34.161394    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 09:14:34.161985 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:34.161458    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls podName:dbfb9779-5ab4-48b3-957f-7f0f503aa28e nodeName:}" failed. No retries permitted until 2026-09-15 09:14:38.161438452 +0000 UTC m=+41.810854548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-d7dcd" (UID: "dbfb9779-5ab4-48b3-957f-7f0f503aa28e") : secret "cluster-monitoring-operator-tls" not found
Sep 15 09:14:34.161985 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:34.161885    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:14:34.161985 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:34.161936    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls podName:067feeac-5425-4c11-b58a-5d2f8cf37015 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:38.161920196 +0000 UTC m=+41.811336281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls") pod "dns-default-zntgf" (UID: "067feeac-5425-4c11-b58a-5d2f8cf37015") : secret "dns-default-metrics-tls" not found
Sep 15 09:14:34.224382 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:34.224309    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:34.263170 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:34.263141    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:34.263744 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:34.263229    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:34.263744 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:34.263414    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle podName:49237773-7a17-4886-b757-650adf21b082 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:38.263392753 +0000 UTC m=+41.912808823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle") pod "router-default-5995ff59fb-4rbww" (UID: "49237773-7a17-4886-b757-650adf21b082") : configmap references non-existent config key: service-ca.crt
Sep 15 09:14:34.263918 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:34.263850    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 09:14:34.263918 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:34.263908    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs podName:49237773-7a17-4886-b757-650adf21b082 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:38.263891508 +0000 UTC m=+41.913307597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs") pod "router-default-5995ff59fb-4rbww" (UID: "49237773-7a17-4886-b757-650adf21b082") : secret "router-metrics-certs-default" not found
Sep 15 09:14:34.306717 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:34.306678    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nx8dj" event={"ID":"6272a978-5c5f-452a-88c0-91affa1d942c","Type":"ContainerStarted","Data":"710684a88ac6c543a64bad7627b5bdb5e3e4f85518cf2007c65e3340ea003d21"}
Sep 15 09:14:34.329387 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:34.329282    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nx8dj" podStartSLOduration=8.419675633 podStartE2EDuration="37.329257942s" totalImagesPullingTime="28.909582309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:13:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:34.329033879 +0000 UTC m=+37.978450165" watchObservedRunningTime="2026-09-15 09:14:34.329257942 +0000 UTC m=+37.978674037"
Sep 15 09:14:34.459786 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:34.459725    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:34.541061 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:34.540975    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:35.396580 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:35.396266    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:35.459842 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:35.459655    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:36.034973 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:36.034936    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:36.097737 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:36.097651    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:36.452809 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:36.452753    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:36.553069 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:36.553009    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:36.785610 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:36.785304    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:36.886632 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:36.886602    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:37.464049 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:37.464007    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:37.561047 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:37.560994    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:38.105697 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:38.105661    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:38.105697 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:38.105703    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ctxmb\" (UID: \"f495280a-a90e-4da0-9651-85113acabb38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb"
Sep 15 09:14:38.105939 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:38.105831    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 09:14:38.105939 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:38.105847    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 09:14:38.105939 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:38.105870    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56ff45949-wvktt: secret "image-registry-tls" not found
Sep 15 09:14:38.105939 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:38.105906    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls podName:f495280a-a90e-4da0-9651-85113acabb38 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:46.10588493 +0000 UTC m=+49.755301001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-ctxmb" (UID: "f495280a-a90e-4da0-9651-85113acabb38") : secret "samples-operator-tls" not found
Sep 15 09:14:38.105939 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:38.105932    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls podName:f1433d91-fffc-49fe-b0e7-0ec14fa27689 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:46.105914545 +0000 UTC m=+49.755330634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls") pod "image-registry-56ff45949-wvktt" (UID: "f1433d91-fffc-49fe-b0e7-0ec14fa27689") : secret "image-registry-tls" not found
Sep 15 09:14:38.207136 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:38.207096    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:14:38.207291 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:38.207202    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-d7dcd\" (UID: \"dbfb9779-5ab4-48b3-957f-7f0f503aa28e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:14:38.207291 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:38.207260    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:14:38.207412 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:38.207325    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls podName:067feeac-5425-4c11-b58a-5d2f8cf37015 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:46.207307897 +0000 UTC m=+49.856723972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls") pod "dns-default-zntgf" (UID: "067feeac-5425-4c11-b58a-5d2f8cf37015") : secret "dns-default-metrics-tls" not found
Sep 15 09:14:38.207412 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:38.207353    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 09:14:38.207412 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:38.207402    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls podName:dbfb9779-5ab4-48b3-957f-7f0f503aa28e nodeName:}" failed. No retries permitted until 2026-09-15 09:14:46.207390025 +0000 UTC m=+49.856806096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-d7dcd" (UID: "dbfb9779-5ab4-48b3-957f-7f0f503aa28e") : secret "cluster-monitoring-operator-tls" not found
Sep 15 09:14:38.308573 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:38.308540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:38.308716 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:38.308637    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:38.308716 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:38.308702    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle podName:49237773-7a17-4886-b757-650adf21b082 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:46.308680869 +0000 UTC m=+49.958096940 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle") pod "router-default-5995ff59fb-4rbww" (UID: "49237773-7a17-4886-b757-650adf21b082") : configmap references non-existent config key: service-ca.crt
Sep 15 09:14:38.308829 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:38.308759    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 09:14:38.308829 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:38.308817    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs podName:49237773-7a17-4886-b757-650adf21b082 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:46.308801492 +0000 UTC m=+49.958217564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs") pod "router-default-5995ff59fb-4rbww" (UID: "49237773-7a17-4886-b757-650adf21b082") : secret "router-metrics-certs-default" not found
Sep 15 09:14:38.424250 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:38.424219    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:40.270197 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:40.270159    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:40.371425 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:40.371385    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:40.471211 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:40.471168    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:40.522719 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:40.522620    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:46.180541 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.180504    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:14:46.180939 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.180583    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ctxmb\" (UID: \"f495280a-a90e-4da0-9651-85113acabb38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb"
Sep 15 09:14:46.180939 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:46.180667    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 09:14:46.180939 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:46.180688    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56ff45949-wvktt: secret "image-registry-tls" not found
Sep 15 09:14:46.180939 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:46.180689    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 09:14:46.180939 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:46.180747    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls podName:f495280a-a90e-4da0-9651-85113acabb38 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:02.18073156 +0000 UTC m=+65.830147631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-ctxmb" (UID: "f495280a-a90e-4da0-9651-85113acabb38") : secret "samples-operator-tls" not found
Sep 15 09:14:46.180939 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:46.180777    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls podName:f1433d91-fffc-49fe-b0e7-0ec14fa27689 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:02.18075414 +0000 UTC m=+65.830170211 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls") pod "image-registry-56ff45949-wvktt" (UID: "f1433d91-fffc-49fe-b0e7-0ec14fa27689") : secret "image-registry-tls" not found
Sep 15 09:14:46.282148 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.282117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-d7dcd\" (UID: \"dbfb9779-5ab4-48b3-957f-7f0f503aa28e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:14:46.282259 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.282240    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:14:46.282390 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:46.282370    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:14:46.282473 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:46.282432    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls podName:067feeac-5425-4c11-b58a-5d2f8cf37015 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:02.282414329 +0000 UTC m=+65.931830405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls") pod "dns-default-zntgf" (UID: "067feeac-5425-4c11-b58a-5d2f8cf37015") : secret "dns-default-metrics-tls" not found
Sep 15 09:14:46.282546 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:46.282481    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 09:14:46.282546 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:46.282506    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls podName:dbfb9779-5ab4-48b3-957f-7f0f503aa28e nodeName:}" failed. No retries permitted until 2026-09-15 09:15:02.282496302 +0000 UTC m=+65.931912372 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-d7dcd" (UID: "dbfb9779-5ab4-48b3-957f-7f0f503aa28e") : secret "cluster-monitoring-operator-tls" not found
Sep 15 09:14:46.351054 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.350557    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f7c5568d-ngfrs" event={"ID":"6e02c47f-25b4-4d5d-b16b-eec4eb0f4172","Type":"ContainerStarted","Data":"0f44581e990d3a788b4bf68404e0d7e88d2fbac41569b0af1db2b2a1fc61faf4"}
Sep 15 09:14:46.358845 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.358044    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg" event={"ID":"94c76993-536e-4925-990b-8244b58c8879","Type":"ContainerStarted","Data":"74730dce79f9d0ee568ccc745d1545b60708d4a0c2a44465681011741e74badb"}
Sep 15 09:14:46.361416 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.360901    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/0.log"
Sep 15 09:14:46.361416 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.360937    2575 generic.go:356] "Generic (PLEG): container finished" podID="19bd1cc7-62fa-4d3e-b603-90af4ec6d509" containerID="078e869449ca4e6bc5ce48d1f45f0d308462ae8d286573965219f7bf16671f1e" exitCode=255
Sep 15 09:14:46.361416 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.361015    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-t9m6q" event={"ID":"19bd1cc7-62fa-4d3e-b603-90af4ec6d509","Type":"ContainerDied","Data":"078e869449ca4e6bc5ce48d1f45f0d308462ae8d286573965219f7bf16671f1e"}
Sep 15 09:14:46.361416 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.361285    2575 scope.go:117] "RemoveContainer" containerID="078e869449ca4e6bc5ce48d1f45f0d308462ae8d286573965219f7bf16671f1e"
Sep 15 09:14:46.368939 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.368780    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f7c5568d-ngfrs" podStartSLOduration=32.425205123 podStartE2EDuration="46.368741503s" totalImagesPullingTime="13.94353638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:46.368474552 +0000 UTC m=+50.017890648" watchObservedRunningTime="2026-09-15 09:14:46.368741503 +0000 UTC m=+50.018157597"
Sep 15 09:14:46.369965 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.369864    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mcckq" event={"ID":"6b4c7605-a586-49d3-9cd7-b0d0502947aa","Type":"ContainerStarted","Data":"414564103f608c487041dc2c9b7f138ba372f429f51db503675f4b59db7f9b76"}
Sep 15 09:14:46.369965 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.369915    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:14:46.373162 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.372208    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d44h8" event={"ID":"15eafc79-a1c2-4649-93d1-8fcc4297f3b6","Type":"ContainerStarted","Data":"3a3f9a7b3f901ef140cee8c653f3ccb5d24f3c7faab68b5dc2ffc54db5875318"}
Sep 15 09:14:46.379051 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.378841    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-m42w5" event={"ID":"da8b4d1e-c64f-4da2-b691-bd2d28213158","Type":"ContainerStarted","Data":"90c57990e0ec5c5c8eb9bac1f92b97f5e604c56e47a1eacfd645adfaf3178f1c"}
Sep 15 09:14:46.383659 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.382604    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:46.383659 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.382750    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:14:46.383659 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:46.382929    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 09:14:46.383659 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:46.382976    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs podName:49237773-7a17-4886-b757-650adf21b082 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:02.382960297 +0000 UTC m=+66.032376376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs") pod "router-default-5995ff59fb-4rbww" (UID: "49237773-7a17-4886-b757-650adf21b082") : secret "router-metrics-certs-default" not found
Sep 15 09:14:46.383659 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:46.383046    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle podName:49237773-7a17-4886-b757-650adf21b082 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:02.383035441 +0000 UTC m=+66.032451517 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle") pod "router-default-5995ff59fb-4rbww" (UID: "49237773-7a17-4886-b757-650adf21b082") : configmap references non-existent config key: service-ca.crt
Sep 15 09:14:46.392507 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.392444    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz" event={"ID":"274f31e2-bcdb-4c89-be9a-228dc2716890","Type":"ContainerStarted","Data":"d35473cbaf5e17170e762d97f55a962c37d1dfc23fb7aaa6a5c01ad0901b9dd6"}
Sep 15 09:14:46.399580 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.398661    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh" event={"ID":"00db89bc-2f90-477a-9649-cefe1877671c","Type":"ContainerStarted","Data":"1f7ead67a7120ae3e7590aaa849bb2c275b8509cc2b74e48c1e7ea8c67ab9d5c"}
Sep 15 09:14:46.401093 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.400948    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6r9pn" event={"ID":"8762be19-3c51-4ef7-8df4-ee06993466ad","Type":"ContainerStarted","Data":"a2f04864949f71ed315ec93ea1538e67e02d43b32ed50abfdc2f5dfb118987d6"}
Sep 15 09:14:46.405183 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.405136    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-2wvs2" event={"ID":"00e2f7b7-6323-4c32-abe4-5405e244cf0c","Type":"ContainerStarted","Data":"2f6aea5428d249b0032585a6a8a32f311174be01c627061f1bd950323cc217ca"}
Sep 15 09:14:46.407068 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.406641    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz"
Sep 15 09:14:46.408343 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.408273    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz"
Sep 15 09:14:46.425475 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.425371    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg" podStartSLOduration=4.365637283 podStartE2EDuration="18.425350258s" totalImagesPullingTime="14.059712975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:46.423925772 +0000 UTC m=+50.073341866" watchObservedRunningTime="2026-09-15 09:14:46.425350258 +0000 UTC m=+50.074766353"
Sep 15 09:14:46.444420 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.443609    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-m42w5" podStartSLOduration=4.372521616 podStartE2EDuration="18.443586937s" totalImagesPullingTime="14.071065321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:46.443231859 +0000 UTC m=+50.092647953" watchObservedRunningTime="2026-09-15 09:14:46.443586937 +0000 UTC m=+50.093003034"
Sep 15 09:14:46.463275 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.462610    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d44h8" podStartSLOduration=2.39130246 podStartE2EDuration="16.462591847s" totalImagesPullingTime="14.071289387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:46.461051132 +0000 UTC m=+50.110467228" watchObservedRunningTime="2026-09-15 09:14:46.462591847 +0000 UTC m=+50.112007941"
Sep 15 09:14:46.484344 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.484288    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mcckq" podStartSLOduration=35.520731292 podStartE2EDuration="49.484269653s" totalImagesPullingTime="13.963538361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:46.481314925 +0000 UTC m=+50.130731021" watchObservedRunningTime="2026-09-15 09:14:46.484269653 +0000 UTC m=+50.133685744"
Sep 15 09:14:46.521953 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.521899    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59ccf45976-2qpxz" podStartSLOduration=32.196249379 podStartE2EDuration="46.521877414s" totalImagesPullingTime="14.325628035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:46.504801807 +0000 UTC m=+50.154217899" watchObservedRunningTime="2026-09-15 09:14:46.521877414 +0000 UTC m=+50.171293509"
Sep 15 09:14:46.523100 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.523060    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6r9pn" podStartSLOduration=4.549619421 podStartE2EDuration="18.523044773s" totalImagesPullingTime="13.973425352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:46.522919081 +0000 UTC m=+50.172335176" watchObservedRunningTime="2026-09-15 09:14:46.523044773 +0000 UTC m=+50.172460868"
Sep 15 09:14:46.545818 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.545746    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-2wvs2" podStartSLOduration=4.478511212 podStartE2EDuration="18.54572725s" totalImagesPullingTime="14.067216038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:46.544222307 +0000 UTC m=+50.193638401" watchObservedRunningTime="2026-09-15 09:14:46.54572725 +0000 UTC m=+50.195143344"
Sep 15 09:14:46.617928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.617844    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:46.675704 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:46.675677    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:47.353263 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.353231    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:47.411192 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.411157    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh" event={"ID":"00db89bc-2f90-477a-9649-cefe1877671c","Type":"ContainerStarted","Data":"375efebff80201ee9102b0d1c091c8e391ee975fa264af319f1b0c29871ec97f"}
Sep 15 09:14:47.411369 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.411208    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh" event={"ID":"00db89bc-2f90-477a-9649-cefe1877671c","Type":"ContainerStarted","Data":"168f7acb8025965d896aa96dc8f5fa7003bba3fb7a42b8b3a0ed664891edcfa6"}
Sep 15 09:14:47.412859 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.412836    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:14:47.413322 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.413303    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/0.log"
Sep 15 09:14:47.413448 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.413342    2575 generic.go:356] "Generic (PLEG): container finished" podID="19bd1cc7-62fa-4d3e-b603-90af4ec6d509" containerID="a97639632724386ecb511cc3c46dc438078f18248cd39b3851fcf44844556d7e" exitCode=255
Sep 15 09:14:47.413508 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.413451    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-t9m6q" event={"ID":"19bd1cc7-62fa-4d3e-b603-90af4ec6d509","Type":"ContainerDied","Data":"a97639632724386ecb511cc3c46dc438078f18248cd39b3851fcf44844556d7e"}
Sep 15 09:14:47.413508 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.413489    2575 scope.go:117] "RemoveContainer" containerID="078e869449ca4e6bc5ce48d1f45f0d308462ae8d286573965219f7bf16671f1e"
Sep 15 09:14:47.413689 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.413673    2575 scope.go:117] "RemoveContainer" containerID="a97639632724386ecb511cc3c46dc438078f18248cd39b3851fcf44844556d7e"
Sep 15 09:14:47.413893 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:47.413873    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-t9m6q_openshift-console-operator(19bd1cc7-62fa-4d3e-b603-90af4ec6d509)\"" pod="openshift-console-operator/console-operator-696884fb9c-t9m6q" podUID="19bd1cc7-62fa-4d3e-b603-90af4ec6d509"
Sep 15 09:14:47.419907 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.419887    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:47.431707 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.431665    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh" podStartSLOduration=33.469065734 podStartE2EDuration="47.431653538s" totalImagesPullingTime="13.962587804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:47.43057183 +0000 UTC m=+51.079987923" watchObservedRunningTime="2026-09-15 09:14:47.431653538 +0000 UTC m=+51.081069630"
Sep 15 09:14:47.480875 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.480847    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:47.703413 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.703386    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wqxxs"]
Sep 15 09:14:47.706914 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.706885    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:47.709087 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.709061    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 09:14:47.709214 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.709061    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 09:14:47.709467 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.709448    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pkv2r\""
Sep 15 09:14:47.718600 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.718570    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wqxxs"]
Sep 15 09:14:47.727115 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.727026    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:47.780586 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.780557    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:47.796403 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.796378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-data-volume\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:47.796545 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.796430    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:47.796658 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.796639    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtsrv\" (UniqueName: \"kubernetes.io/projected/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-api-access-xtsrv\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:47.796695 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.796680    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:47.796745 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.796709    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-crio-socket\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:47.897901 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.897868    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtsrv\" (UniqueName: \"kubernetes.io/projected/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-api-access-xtsrv\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:47.898062 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.897909    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:47.898062 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.897934    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-crio-socket\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:47.898062 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.897966    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-data-volume\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:47.898062 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.898035    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-crio-socket\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:47.898062 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:47.898049    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:47.898258 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:47.898106    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls podName:f6b9f3cc-cc0e-4150-9353-6dd6f77afe88 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:48.398088552 +0000 UTC m=+52.047504639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wqxxs" (UID: "f6b9f3cc-cc0e-4150-9353-6dd6f77afe88") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:47.898258 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.898125    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:47.898258 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:47.898211    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 09:14:47.898258 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:47.898251    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm podName:f6b9f3cc-cc0e-4150-9353-6dd6f77afe88 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:48.39823747 +0000 UTC m=+52.047653542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wqxxs" (UID: "f6b9f3cc-cc0e-4150-9353-6dd6f77afe88") : configmap "kube-rbac-proxy" not found
Sep 15 09:14:47.898410 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.898279    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-data-volume\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:47.908114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:47.908088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtsrv\" (UniqueName: \"kubernetes.io/projected/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-api-access-xtsrv\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:48.402927 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:48.402886    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:48.403334 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:48.402942    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:48.403334 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:48.403064    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:48.403334 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:48.403091    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 09:14:48.403334 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:48.403152    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls podName:f6b9f3cc-cc0e-4150-9353-6dd6f77afe88 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:49.403128043 +0000 UTC m=+53.052544123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wqxxs" (UID: "f6b9f3cc-cc0e-4150-9353-6dd6f77afe88") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:48.403334 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:48.403172    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm podName:f6b9f3cc-cc0e-4150-9353-6dd6f77afe88 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:49.403162338 +0000 UTC m=+53.052578414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wqxxs" (UID: "f6b9f3cc-cc0e-4150-9353-6dd6f77afe88") : configmap "kube-rbac-proxy" not found
Sep 15 09:14:48.419265 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:48.419243    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:14:48.419632 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:48.419617    2575 scope.go:117] "RemoveContainer" containerID="a97639632724386ecb511cc3c46dc438078f18248cd39b3851fcf44844556d7e"
Sep 15 09:14:48.419802 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:48.419758    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-t9m6q_openshift-console-operator(19bd1cc7-62fa-4d3e-b603-90af4ec6d509)\"" pod="openshift-console-operator/console-operator-696884fb9c-t9m6q" podUID="19bd1cc7-62fa-4d3e-b603-90af4ec6d509"
Sep 15 09:14:49.413413 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:49.413385    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:49.413815 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:49.413444    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:49.413815 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:49.413538    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:49.413815 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:49.413594    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 09:14:49.413815 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:49.413610    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls podName:f6b9f3cc-cc0e-4150-9353-6dd6f77afe88 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:51.413593858 +0000 UTC m=+55.063009929 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wqxxs" (UID: "f6b9f3cc-cc0e-4150-9353-6dd6f77afe88") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:49.413815 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:49.413658    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm podName:f6b9f3cc-cc0e-4150-9353-6dd6f77afe88 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:51.413639576 +0000 UTC m=+55.063055652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wqxxs" (UID: "f6b9f3cc-cc0e-4150-9353-6dd6f77afe88") : configmap "kube-rbac-proxy" not found
Sep 15 09:14:49.424502 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:49.424474    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw" event={"ID":"187ce716-9a59-4735-9a96-7ee6e614f78e","Type":"ContainerStarted","Data":"9e04984bb90f381bb4b76c4324f98d61eb1db7b05da0191bc386ad2b554edda2"}
Sep 15 09:14:49.439636 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:49.439594    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw" podStartSLOduration=4.320819064 podStartE2EDuration="21.439576812s" totalImagesPullingTime="17.118757748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-09-15 09:14:49.438085469 +0000 UTC m=+53.087501563" watchObservedRunningTime="2026-09-15 09:14:49.439576812 +0000 UTC m=+53.088992907"
Sep 15 09:14:50.110646 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:50.110613    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:50.164740 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:50.164714    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:50.273221 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:50.273202    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8fznm_06f3e00e-6b02-4341-af4c-3228fdb5f592/dns-node-resolver/0.log"
Sep 15 09:14:50.628826 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:50.628789    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:14:50.629178 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:50.628860    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:14:50.629270 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:50.629257    2575 scope.go:117] "RemoveContainer" containerID="a97639632724386ecb511cc3c46dc438078f18248cd39b3851fcf44844556d7e"
Sep 15 09:14:50.629455 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:50.629435    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-t9m6q_openshift-console-operator(19bd1cc7-62fa-4d3e-b603-90af4ec6d509)\"" pod="openshift-console-operator/console-operator-696884fb9c-t9m6q" podUID="19bd1cc7-62fa-4d3e-b603-90af4ec6d509"
Sep 15 09:14:50.873916 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:50.873893    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hgkhw_f3ac0b66-da35-4fc2-964a-e6583ff9a29f/node-ca/0.log"
Sep 15 09:14:51.129666 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:51.129631    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:51.429252 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:51.429223    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:51.429443 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:51.429348    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 09:14:51.429443 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:51.429363    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:51.429443 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:51.429427    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm podName:f6b9f3cc-cc0e-4150-9353-6dd6f77afe88 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:55.429407064 +0000 UTC m=+59.078823147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wqxxs" (UID: "f6b9f3cc-cc0e-4150-9353-6dd6f77afe88") : configmap "kube-rbac-proxy" not found
Sep 15 09:14:51.429616 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:51.429475    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:51.429616 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:51.429526    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls podName:f6b9f3cc-cc0e-4150-9353-6dd6f77afe88 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:55.429511442 +0000 UTC m=+59.078927529 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wqxxs" (UID: "f6b9f3cc-cc0e-4150-9353-6dd6f77afe88") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:51.555932 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:51.555904    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:51.675013 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:51.674983    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d44h8_15eafc79-a1c2-4649-93d1-8fcc4297f3b6/serve-healthcheck-canary/0.log"
Sep 15 09:14:51.856274 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:51.856192    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:51.952363 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:51.952329    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:52.476131 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:52.476100    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-xz7jg_94c76993-536e-4925-990b-8244b58c8879/kube-storage-version-migrator-operator/0.log"
Sep 15 09:14:53.465502 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:53.465471    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:53.521896 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:53.521871    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:54.358785 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:54.358740    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:54.452498 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:54.452465    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:55.465145 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:55.465110    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:55.465575 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:55.465158    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:14:55.465575 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:55.465237    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 09:14:55.465575 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:55.465301    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:55.465575 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:55.465311    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm podName:f6b9f3cc-cc0e-4150-9353-6dd6f77afe88 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:03.465297067 +0000 UTC m=+67.114713139 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wqxxs" (UID: "f6b9f3cc-cc0e-4150-9353-6dd6f77afe88") : configmap "kube-rbac-proxy" not found
Sep 15 09:14:55.465575 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:14:55.465388    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls podName:f6b9f3cc-cc0e-4150-9353-6dd6f77afe88 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:03.465369611 +0000 UTC m=+67.114785686 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wqxxs" (UID: "f6b9f3cc-cc0e-4150-9353-6dd6f77afe88") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:57.020156 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:57.020123    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:57.135926 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:57.135899    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hj965"
Sep 15 09:14:58.705029 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:58.704999    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:58.805975 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:58.805943    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:59.044614 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:59.044540    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:59.147910 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:59.147875    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:59.245802 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:59.245746    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:59.302724 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:59.302646    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:59.402290 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:59.402264    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:14:59.806260 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:14:59.806225    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:00.370706 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:00.370675    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:00.605060 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:00.605029    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:01.247091 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:01.247056    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:01.401606 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:01.401557    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:01.801139 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:01.801110    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:01.901482 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:01.901453    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:02.004076 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.004046    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:02.221972 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.221938    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:15:02.222139 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.221984    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ctxmb\" (UID: \"f495280a-a90e-4da0-9651-85113acabb38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb"
Sep 15 09:15:02.222139 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:15:02.222095    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 09:15:02.222139 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:15:02.222118    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56ff45949-wvktt: secret "image-registry-tls" not found
Sep 15 09:15:02.222271 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:15:02.222246    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls podName:f1433d91-fffc-49fe-b0e7-0ec14fa27689 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:34.222228389 +0000 UTC m=+97.871644462 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls") pod "image-registry-56ff45949-wvktt" (UID: "f1433d91-fffc-49fe-b0e7-0ec14fa27689") : secret "image-registry-tls" not found
Sep 15 09:15:02.224478 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.224439    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f495280a-a90e-4da0-9651-85113acabb38-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ctxmb\" (UID: \"f495280a-a90e-4da0-9651-85113acabb38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb"
Sep 15 09:15:02.323070 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.323043    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-d7dcd\" (UID: \"dbfb9779-5ab4-48b3-957f-7f0f503aa28e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:15:02.323484 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.323134    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:15:02.323484 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:15:02.323213    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 09:15:02.323484 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:15:02.323316    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls podName:dbfb9779-5ab4-48b3-957f-7f0f503aa28e nodeName:}" failed. No retries permitted until 2026-09-15 09:15:34.323294193 +0000 UTC m=+97.972710266 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-d7dcd" (UID: "dbfb9779-5ab4-48b3-957f-7f0f503aa28e") : secret "cluster-monitoring-operator-tls" not found
Sep 15 09:15:02.325643 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.325619    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/067feeac-5425-4c11-b58a-5d2f8cf37015-metrics-tls\") pod \"dns-default-zntgf\" (UID: \"067feeac-5425-4c11-b58a-5d2f8cf37015\") " pod="openshift-dns/dns-default-zntgf"
Sep 15 09:15:02.423911 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.423882    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:15:02.424037 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.423939    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:15:02.424037 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:15:02.424007    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 09:15:02.424105 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:15:02.424072    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs podName:49237773-7a17-4886-b757-650adf21b082 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:34.424053759 +0000 UTC m=+98.073469831 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs") pod "router-default-5995ff59fb-4rbww" (UID: "49237773-7a17-4886-b757-650adf21b082") : secret "router-metrics-certs-default" not found
Sep 15 09:15:02.424105 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:15:02.424094    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle podName:49237773-7a17-4886-b757-650adf21b082 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:34.424080793 +0000 UTC m=+98.073496897 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle") pod "router-default-5995ff59fb-4rbww" (UID: "49237773-7a17-4886-b757-650adf21b082") : configmap references non-existent config key: service-ca.crt
Sep 15 09:15:02.442690 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.442669    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8cswm\""
Sep 15 09:15:02.451377 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.451361    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb"
Sep 15 09:15:02.479831 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.479750    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r95hw\""
Sep 15 09:15:02.488609 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.488579    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zntgf"
Sep 15 09:15:02.525557 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.525390    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs\") pod \"network-metrics-daemon-2jd2s\" (UID: \"05297e11-2660-4980-a495-baccd89ae99f\") " pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:15:02.527643 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.527627    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 09:15:02.536460 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:15:02.536436    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 15 09:15:02.536599 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:15:02.536502    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs podName:05297e11-2660-4980-a495-baccd89ae99f nodeName:}" failed. No retries permitted until 2026-09-15 09:16:06.5364853 +0000 UTC m=+130.185901371 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs") pod "network-metrics-daemon-2jd2s" (UID: "05297e11-2660-4980-a495-baccd89ae99f") : secret "metrics-daemon-secret" not found
Sep 15 09:15:02.611441 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.611408    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:02.626325 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.626298    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret\") pod \"global-pull-secret-syncer-rwg82\" (UID: \"12d964ec-1ded-49e8-bd7c-18c450406339\") " pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:15:02.628901 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.628884    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 09:15:02.639216 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.639194    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d964ec-1ded-49e8-bd7c-18c450406339-original-pull-secret\") pod \"global-pull-secret-syncer-rwg82\" (UID: \"12d964ec-1ded-49e8-bd7c-18c450406339\") " pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:15:02.672350 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.672329    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:02.691548 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.691528    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwg82"
Sep 15 09:15:02.720733 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.720712    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb"]
Sep 15 09:15:02.761384 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.761182    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zntgf"]
Sep 15 09:15:02.763993 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:15:02.763965    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod067feeac_5425_4c11_b58a_5d2f8cf37015.slice/crio-0588bfa0305dc2c99e80de637e7f97ed4e99bf25f098c70f9f23ac112a12797a WatchSource:0}: Error finding container 0588bfa0305dc2c99e80de637e7f97ed4e99bf25f098c70f9f23ac112a12797a: Status 404 returned error can't find the container with id 0588bfa0305dc2c99e80de637e7f97ed4e99bf25f098c70f9f23ac112a12797a
Sep 15 09:15:02.959605 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:02.959563    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rwg82"]
Sep 15 09:15:02.961506 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:15:02.961483    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d964ec_1ded_49e8_bd7c_18c450406339.slice/crio-5f1d335d310754cd0814c4e1bf6c183e85df92fd39e68efcf10a5aefc52548e4 WatchSource:0}: Error finding container 5f1d335d310754cd0814c4e1bf6c183e85df92fd39e68efcf10a5aefc52548e4: Status 404 returned error can't find the container with id 5f1d335d310754cd0814c4e1bf6c183e85df92fd39e68efcf10a5aefc52548e4
Sep 15 09:15:03.010664 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:03.010609    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:03.401916 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:03.401861    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:03.468189 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:03.468141    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:03.472536 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:03.472511    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rwg82" event={"ID":"12d964ec-1ded-49e8-bd7c-18c450406339","Type":"ContainerStarted","Data":"5f1d335d310754cd0814c4e1bf6c183e85df92fd39e68efcf10a5aefc52548e4"}
Sep 15 09:15:03.473997 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:03.473939    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zntgf" event={"ID":"067feeac-5425-4c11-b58a-5d2f8cf37015","Type":"ContainerStarted","Data":"0588bfa0305dc2c99e80de637e7f97ed4e99bf25f098c70f9f23ac112a12797a"}
Sep 15 09:15:03.475290 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:03.475258    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb" event={"ID":"f495280a-a90e-4da0-9651-85113acabb38","Type":"ContainerStarted","Data":"75fca7b7a943700f11c9659bf82480642ef8f77617852020a743c350ea915f54"}
Sep 15 09:15:03.533653 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:03.533618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:15:03.533868 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:03.533679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:15:03.533868 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:15:03.533741    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:15:03.533868 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:15:03.533829    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls podName:f6b9f3cc-cc0e-4150-9353-6dd6f77afe88 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:19.533807863 +0000 UTC m=+83.183223938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wqxxs" (UID: "f6b9f3cc-cc0e-4150-9353-6dd6f77afe88") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:15:03.534339 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:03.534310    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:15:03.630334 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:03.630291    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:03.999431 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:03.999393    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:04.808962 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:04.808928    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:04.855152 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:04.855122    2575 scope.go:117] "RemoveContainer" containerID="a97639632724386ecb511cc3c46dc438078f18248cd39b3851fcf44844556d7e"
Sep 15 09:15:05.102780 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:05.102681    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:05.203678 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:05.203646    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:05.394476 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:05.394447    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:05.494644 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:05.494618    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:05.605083 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:05.604995    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:05.806405 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:05.806306    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:06.492700 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:06.492663    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:15:06.493166 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:06.492803    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-t9m6q" event={"ID":"19bd1cc7-62fa-4d3e-b603-90af4ec6d509","Type":"ContainerStarted","Data":"1b07f642a579a7a1b1d26e5a0f893161f23c54d3cf737f58079d82f1e91fae83"}
Sep 15 09:15:06.493448 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:06.493428    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:15:06.497555 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:06.495149    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zntgf" event={"ID":"067feeac-5425-4c11-b58a-5d2f8cf37015","Type":"ContainerStarted","Data":"4c795ac73fc121362e7023e658428e00ab2c34ccfb9891bf76176fcb31d0f0ef"}
Sep 15 09:15:06.497555 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:06.495206    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zntgf" event={"ID":"067feeac-5425-4c11-b58a-5d2f8cf37015","Type":"ContainerStarted","Data":"07002f402b90c0d396078671d9da33b66fa46cffe9c12cf819e9c7f58408b988"}
Sep 15 09:15:06.497555 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:06.495249    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zntgf"
Sep 15 09:15:06.497555 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:06.497435    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb" event={"ID":"f495280a-a90e-4da0-9651-85113acabb38","Type":"ContainerStarted","Data":"8fd2b24b65acf9b1770a39e28ac125b56522e11dda3f5ab80754f660d9c483f8"}
Sep 15 09:15:06.497555 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:06.497472    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb" event={"ID":"f495280a-a90e-4da0-9651-85113acabb38","Type":"ContainerStarted","Data":"ab0a6764c8954c4474e9a89ece10583a65f0f13847ed75a158df9910a306dc65"}
Sep 15 09:15:06.498929 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:06.498904    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-t9m6q"
Sep 15 09:15:06.510446 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:06.510396    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-t9m6q" podStartSLOduration=24.451303925 podStartE2EDuration="38.510378601s" totalImagesPullingTime="14.059074676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:06.508964872 +0000 UTC m=+70.158380968" watchObservedRunningTime="2026-09-15 09:15:06.510378601 +0000 UTC m=+70.159794696"
Sep 15 09:15:06.514555 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:06.514522    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:06.543177 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:06.543127    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zntgf" podStartSLOduration=33.878986413 podStartE2EDuration="36.543113422s" totalImagesPullingTime="2.664127009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:06.54175796 +0000 UTC m=+70.191174052" watchObservedRunningTime="2026-09-15 09:15:06.543113422 +0000 UTC m=+70.192529558"
Sep 15 09:15:06.559618 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:06.559565    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ctxmb" podStartSLOduration=35.903221666 podStartE2EDuration="38.559545277s" totalImagesPullingTime="2.656323611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:06.558325518 +0000 UTC m=+70.207741611" watchObservedRunningTime="2026-09-15 09:15:06.559545277 +0000 UTC m=+70.208961371"
Sep 15 09:15:06.577080 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:06.577043    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:06.678865 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:06.678834    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:06.807826 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:06.807731    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:07.084238 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:07.084157    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:07.187299 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:07.187270    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:07.288103 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:07.288067    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:07.404185 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:07.404156    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:07.595492 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:07.595460    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:07.656732 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:07.656666    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:07.803323 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:07.803290    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:07.902436 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:07.902407    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:08.002249 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:08.002218    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:08.207562 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:08.207534    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:08.509896 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:08.509862    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rwg82" event={"ID":"12d964ec-1ded-49e8-bd7c-18c450406339","Type":"ContainerStarted","Data":"4121aafdc35516e0c6900b3a64603a4e737103c8f3567f1b3b4f2bce1cc4c5b4"}
Sep 15 09:15:08.526223 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:08.526180    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rwg82" podStartSLOduration=66.507649292 podStartE2EDuration="1m11.526165556s" totalImagesPullingTime="5.018516264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:08.525679727 +0000 UTC m=+72.175095821" watchObservedRunningTime="2026-09-15 09:15:08.526165556 +0000 UTC m=+72.175581651"
Sep 15 09:15:08.800718 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:08.800638    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:09.004669 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:09.004635    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:09.404525 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:09.404497    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:09.601233 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:09.601202    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:09.804327 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:09.804245    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:09.856374 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:09.856350    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:15.435975 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:15.435929    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:15.569246 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:15.569211    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:15.671008 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:15.670976    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:16.502895 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:16.502866    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zntgf"
Sep 15 09:15:16.553397 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:16.553365    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:16.623530 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:16.623500    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:16.756178 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:16.756080    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:16.813756 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:16.813723    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:17.416294 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:17.416269    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mcckq"
Sep 15 09:15:17.816796 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:17.816649    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:17.946252 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:17.946218    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:19.567016 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:19.566987    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:15:19.569487 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:19.569462    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6b9f3cc-cc0e-4150-9353-6dd6f77afe88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqxxs\" (UID: \"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88\") " pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:15:19.822672 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:19.822595    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pkv2r\""
Sep 15 09:15:19.831451 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:19.831435    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wqxxs"
Sep 15 09:15:20.128981 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:20.128957    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wqxxs"]
Sep 15 09:15:20.131630 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:15:20.131601    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6b9f3cc_cc0e_4150_9353_6dd6f77afe88.slice/crio-3072cb6f9de481f4ba1672e250fc3b4f43c4c689fb0512db574bd11882376ef0 WatchSource:0}: Error finding container 3072cb6f9de481f4ba1672e250fc3b4f43c4c689fb0512db574bd11882376ef0: Status 404 returned error can't find the container with id 3072cb6f9de481f4ba1672e250fc3b4f43c4c689fb0512db574bd11882376ef0
Sep 15 09:15:20.230213 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:20.230187    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:20.329747 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:20.329720    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:20.551355 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:20.551323    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wqxxs" event={"ID":"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88","Type":"ContainerStarted","Data":"bcb65ff51503281c0bfd044da8644e27fd049ce225dd482374b4f07fe06dccba"}
Sep 15 09:15:20.551555 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:20.551377    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wqxxs" event={"ID":"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88","Type":"ContainerStarted","Data":"3072cb6f9de481f4ba1672e250fc3b4f43c4c689fb0512db574bd11882376ef0"}
Sep 15 09:15:21.556902 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:21.556867    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wqxxs" event={"ID":"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88","Type":"ContainerStarted","Data":"e36e461b4cec644f651dcbec1d21f516501673b4b26c990c152900c633322c54"}
Sep 15 09:15:22.562132 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:22.562101    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wqxxs" event={"ID":"f6b9f3cc-cc0e-4150-9353-6dd6f77afe88","Type":"ContainerStarted","Data":"352b17b817e1215efb003ac1a86c176b20b1749c25c105b53340ef0db54649c6"}
Sep 15 09:15:22.579843 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:22.579800    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wqxxs" podStartSLOduration=33.488246427 podStartE2EDuration="35.579785727s" totalImagesPullingTime="2.0915393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:14:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:22.578744898 +0000 UTC m=+86.228160990" watchObservedRunningTime="2026-09-15 09:15:22.579785727 +0000 UTC m=+86.229201819"
Sep 15 09:15:23.625779 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:23.625744    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:23.683405 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:23.683377    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:24.016347 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:24.016316    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:24.121083 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:24.121054    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:25.185063 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:25.185034    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:27.418969 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:27.418940    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:27.475289 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:27.475256    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:28.881677 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:28.881644    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:28.950254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:28.950225    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:34.273656 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.273614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:15:34.276316 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.276278    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls\") pod \"image-registry-56ff45949-wvktt\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") " pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:15:34.279021 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.278996    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:34.374701 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.374665    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-d7dcd\" (UID: \"dbfb9779-5ab4-48b3-957f-7f0f503aa28e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:15:34.377217 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.377192    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfb9779-5ab4-48b3-957f-7f0f503aa28e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-d7dcd\" (UID: \"dbfb9779-5ab4-48b3-957f-7f0f503aa28e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:15:34.474998 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.474968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:15:34.475115 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.475030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:15:34.475527 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.475508    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49237773-7a17-4886-b757-650adf21b082-service-ca-bundle\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:15:34.477289 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.477266    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49237773-7a17-4886-b757-650adf21b082-metrics-certs\") pod \"router-default-5995ff59fb-4rbww\" (UID: \"49237773-7a17-4886-b757-650adf21b082\") " pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:15:34.480173 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.480158    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pc6pr\""
Sep 15 09:15:34.488217 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.488198    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:15:34.558578 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.558552    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9p5qr\""
Sep 15 09:15:34.566540 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.566515    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"
Sep 15 09:15:34.689683 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.689655    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fjhv9\""
Sep 15 09:15:34.697530 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.697515    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:15:34.760855 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.760821    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56ff45949-wvktt"]
Sep 15 09:15:34.763963 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:15:34.763935    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1433d91_fffc_49fe_b0e7_0ec14fa27689.slice/crio-1050779562d8a88ebfb46c1b6d56400a329b7756349b0c7059dca4fd8233d530 WatchSource:0}: Error finding container 1050779562d8a88ebfb46c1b6d56400a329b7756349b0c7059dca4fd8233d530: Status 404 returned error can't find the container with id 1050779562d8a88ebfb46c1b6d56400a329b7756349b0c7059dca4fd8233d530
Sep 15 09:15:34.843511 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.843481    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd"]
Sep 15 09:15:34.845882 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:15:34.845858    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbfb9779_5ab4_48b3_957f_7f0f503aa28e.slice/crio-8351843a22c6b1f87a89da5bb0815618e069d2d83bb07614922becb2140aad4f WatchSource:0}: Error finding container 8351843a22c6b1f87a89da5bb0815618e069d2d83bb07614922becb2140aad4f: Status 404 returned error can't find the container with id 8351843a22c6b1f87a89da5bb0815618e069d2d83bb07614922becb2140aad4f
Sep 15 09:15:34.971962 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:34.971929    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5995ff59fb-4rbww"]
Sep 15 09:15:34.974604 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:15:34.974576    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49237773_7a17_4886_b757_650adf21b082.slice/crio-c340d1d1529d69fed40631de19e91b8c7c33baf168cf8a2915d24de89f4a16b5 WatchSource:0}: Error finding container c340d1d1529d69fed40631de19e91b8c7c33baf168cf8a2915d24de89f4a16b5: Status 404 returned error can't find the container with id c340d1d1529d69fed40631de19e91b8c7c33baf168cf8a2915d24de89f4a16b5
Sep 15 09:15:35.282243 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:35.282208    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:35.394508 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:35.394469    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:35.497842 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:35.497810    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:35.590112 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:35.590030    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:35.608681 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:35.608650    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd" event={"ID":"dbfb9779-5ab4-48b3-957f-7f0f503aa28e","Type":"ContainerStarted","Data":"8351843a22c6b1f87a89da5bb0815618e069d2d83bb07614922becb2140aad4f"}
Sep 15 09:15:35.610804 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:35.610751    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56ff45949-wvktt" event={"ID":"f1433d91-fffc-49fe-b0e7-0ec14fa27689","Type":"ContainerStarted","Data":"2aa33f2c2e07c5e9d897a30a63c666b89c7008cf9a07fd1ca6779e5852ad9df7"}
Sep 15 09:15:35.610948 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:35.610860    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56ff45949-wvktt" event={"ID":"f1433d91-fffc-49fe-b0e7-0ec14fa27689","Type":"ContainerStarted","Data":"1050779562d8a88ebfb46c1b6d56400a329b7756349b0c7059dca4fd8233d530"}
Sep 15 09:15:35.611109 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:35.611061    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:15:35.612716 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:35.612690    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5995ff59fb-4rbww" event={"ID":"49237773-7a17-4886-b757-650adf21b082","Type":"ContainerStarted","Data":"20970b1a4c4ff6217ceadb4f0e86a182acf963b8b563639b0d4a7e6434640f77"}
Sep 15 09:15:35.612848 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:35.612732    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5995ff59fb-4rbww" event={"ID":"49237773-7a17-4886-b757-650adf21b082","Type":"ContainerStarted","Data":"c340d1d1529d69fed40631de19e91b8c7c33baf168cf8a2915d24de89f4a16b5"}
Sep 15 09:15:35.633847 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:35.633801    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56ff45949-wvktt" podStartSLOduration=98.633758436 podStartE2EDuration="1m38.633758436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:13:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:35.633104448 +0000 UTC m=+99.282520542" watchObservedRunningTime="2026-09-15 09:15:35.633758436 +0000 UTC m=+99.283174531"
Sep 15 09:15:35.657297 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:35.657245    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5995ff59fb-4rbww" podStartSLOduration=67.657227765 podStartE2EDuration="1m7.657227765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:35.657126398 +0000 UTC m=+99.306542493" watchObservedRunningTime="2026-09-15 09:15:35.657227765 +0000 UTC m=+99.306643875"
Sep 15 09:15:35.698737 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:35.698709    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:15:35.701678 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:35.701655    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:15:36.471414 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:36.471373    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:36.574988 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:36.574951    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:36.617315 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:36.617288    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:15:36.618681 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:36.618660    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5995ff59fb-4rbww"
Sep 15 09:15:37.447339 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:37.447308    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:37.521130 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:37.521102    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:37.546635 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:37.546604    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56ff45949-wvktt"]
Sep 15 09:15:37.623391 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:37.623357    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd" event={"ID":"dbfb9779-5ab4-48b3-957f-7f0f503aa28e","Type":"ContainerStarted","Data":"79c440bbc4e634702c45530dd51ab2d1f61222b7ba660776551f13ebc6d8f89a"}
Sep 15 09:15:37.640737 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:37.640708    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:37.648649 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:37.648603    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-d7dcd" podStartSLOduration=67.422491192 podStartE2EDuration="1m9.648586843s" totalImagesPullingTime="2.226095651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:37.647409058 +0000 UTC m=+101.296825152" watchObservedRunningTime="2026-09-15 09:15:37.648586843 +0000 UTC m=+101.298002936"
Sep 15 09:15:37.728405 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:37.728313    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:37.967702 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:37.967672    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:38.068309 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:38.068225    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:38.168204 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:38.168172    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:38.673973 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:38.673934    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:38.730427 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:38.730371    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:41.673175 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:41.673135    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:41.807520 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:41.807481    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:42.011634 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:42.011534    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:44.576204 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:44.576157    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:46.825415 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:46.825385    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:46.925192 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:46.925160    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:47.033754 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.033716    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:47.071914 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.071882    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pwtql"]
Sep 15 09:15:47.074371 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.074351    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.080226 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.080179    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 09:15:47.080539 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.080516    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 09:15:47.080647 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.080600    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dcwhg\""
Sep 15 09:15:47.080750 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.080734    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 09:15:47.081278 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.081254    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 09:15:47.128975 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.128934    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:47.179432 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.179401    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqrf6\" (UniqueName: \"kubernetes.io/projected/299003e7-bfed-45c2-9b2d-b61e3a4552a6-kube-api-access-hqrf6\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.179432 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.179433    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/299003e7-bfed-45c2-9b2d-b61e3a4552a6-root\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.179656 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.179457    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/299003e7-bfed-45c2-9b2d-b61e3a4552a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.179656 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.179516    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/299003e7-bfed-45c2-9b2d-b61e3a4552a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.179656 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.179600    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/299003e7-bfed-45c2-9b2d-b61e3a4552a6-node-exporter-textfile\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.179656 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.179634    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/299003e7-bfed-45c2-9b2d-b61e3a4552a6-node-exporter-wtmp\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.179885 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.179676    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/299003e7-bfed-45c2-9b2d-b61e3a4552a6-node-exporter-tls\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.179885 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.179706    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/299003e7-bfed-45c2-9b2d-b61e3a4552a6-sys\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.179885 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.179736    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/299003e7-bfed-45c2-9b2d-b61e3a4552a6-metrics-client-ca\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.215748 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.215710    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:47.281108 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.281083    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqrf6\" (UniqueName: \"kubernetes.io/projected/299003e7-bfed-45c2-9b2d-b61e3a4552a6-kube-api-access-hqrf6\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.281240 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.281113    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/299003e7-bfed-45c2-9b2d-b61e3a4552a6-root\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.281240 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.281141    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/299003e7-bfed-45c2-9b2d-b61e3a4552a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.281240 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.281168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/299003e7-bfed-45c2-9b2d-b61e3a4552a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.281240 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.281222    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/299003e7-bfed-45c2-9b2d-b61e3a4552a6-node-exporter-textfile\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.281240 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.281235    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/299003e7-bfed-45c2-9b2d-b61e3a4552a6-root\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.281478 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.281247    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/299003e7-bfed-45c2-9b2d-b61e3a4552a6-node-exporter-wtmp\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.281478 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.281285    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/299003e7-bfed-45c2-9b2d-b61e3a4552a6-node-exporter-tls\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.281478 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.281309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/299003e7-bfed-45c2-9b2d-b61e3a4552a6-sys\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.281478 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.281334    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/299003e7-bfed-45c2-9b2d-b61e3a4552a6-metrics-client-ca\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.281668 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.281651    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/299003e7-bfed-45c2-9b2d-b61e3a4552a6-node-exporter-textfile\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.281727 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.281692    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/299003e7-bfed-45c2-9b2d-b61e3a4552a6-sys\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.281904 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.281849    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/299003e7-bfed-45c2-9b2d-b61e3a4552a6-node-exporter-wtmp\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.282043 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.282021    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/299003e7-bfed-45c2-9b2d-b61e3a4552a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.282227 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.282131    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/299003e7-bfed-45c2-9b2d-b61e3a4552a6-metrics-client-ca\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.283905 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.283884    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/299003e7-bfed-45c2-9b2d-b61e3a4552a6-node-exporter-tls\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.284283 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.284261    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/299003e7-bfed-45c2-9b2d-b61e3a4552a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.289603 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.289577    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqrf6\" (UniqueName: \"kubernetes.io/projected/299003e7-bfed-45c2-9b2d-b61e3a4552a6-kube-api-access-hqrf6\") pod \"node-exporter-pwtql\" (UID: \"299003e7-bfed-45c2-9b2d-b61e3a4552a6\") " pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.384723 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.384648    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pwtql"
Sep 15 09:15:47.395295 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:15:47.395271    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299003e7_bfed_45c2_9b2d_b61e3a4552a6.slice/crio-c9ee4a87823684b70670f9357ca602f7fa9a4194540d085dee1fe2118510c7d6 WatchSource:0}: Error finding container c9ee4a87823684b70670f9357ca602f7fa9a4194540d085dee1fe2118510c7d6: Status 404 returned error can't find the container with id c9ee4a87823684b70670f9357ca602f7fa9a4194540d085dee1fe2118510c7d6
Sep 15 09:15:47.405238 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.405215    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:47.581606 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.581575    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:47.649344 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.649319    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:47.661104 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:47.661081    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pwtql" event={"ID":"299003e7-bfed-45c2-9b2d-b61e3a4552a6","Type":"ContainerStarted","Data":"c9ee4a87823684b70670f9357ca602f7fa9a4194540d085dee1fe2118510c7d6"}
Sep 15 09:15:48.036726 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:48.036646    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:48.112825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:48.112796    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:48.486886 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:48.486848    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:48.666802 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:48.666755    2575 generic.go:356] "Generic (PLEG): container finished" podID="299003e7-bfed-45c2-9b2d-b61e3a4552a6" containerID="de93d6b780298872c349c6566e60c9aec472c2f9bb1518f12694ce0c0902907b" exitCode=0
Sep 15 09:15:48.666943 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:48.666800    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pwtql" event={"ID":"299003e7-bfed-45c2-9b2d-b61e3a4552a6","Type":"ContainerDied","Data":"de93d6b780298872c349c6566e60c9aec472c2f9bb1518f12694ce0c0902907b"}
Sep 15 09:15:48.818699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:48.818629    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:48.918367 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:48.918333    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:49.672348 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:49.672320    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pwtql" event={"ID":"299003e7-bfed-45c2-9b2d-b61e3a4552a6","Type":"ContainerStarted","Data":"88bbf10833955234c98d92102d53e6687c086efcf0508bcfb519dda7b36b181a"}
Sep 15 09:15:49.672733 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:49.672369    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pwtql" event={"ID":"299003e7-bfed-45c2-9b2d-b61e3a4552a6","Type":"ContainerStarted","Data":"5182386c29ec57c9af439101bbaebd63e55b2c4988d1e566e1b27156830aee06"}
Sep 15 09:15:49.693404 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:49.693363    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pwtql" podStartSLOduration=1.519578454 podStartE2EDuration="2.693348459s" totalImagesPullingTime="1.098071804s" totalInitContainerRuntime="75.698201ms" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:49.692452398 +0000 UTC m=+113.341868497" watchObservedRunningTime="2026-09-15 09:15:49.693348459 +0000 UTC m=+113.342764579"
Sep 15 09:15:49.882154 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:49.882125    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:49.981750 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:49.981656    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:50.083014 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:50.082983    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:50.182755 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:50.182722    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:50.233080 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:50.233013    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:50.338779 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:50.338739    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:50.440779 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:50.440732    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:50.514739 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:50.514668    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:50.783314 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:50.783252    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:50.883815 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:50.883751    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:50.941152 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:50.941121    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:51.838739 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:51.838692    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:51.937650 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:51.937609    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:52.038410 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:52.038383    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:52.138815 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:52.138746    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:53.356704 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:53.356671    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:53.514946 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:53.514916    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:53.615352 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:53.615278    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:15:57.629675 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:15:57.629646    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:16:02.643218 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:02.643152    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-56ff45949-wvktt" podUID="f1433d91-fffc-49fe-b0e7-0ec14fa27689" containerName="registry" containerID="cri-o://2aa33f2c2e07c5e9d897a30a63c666b89c7008cf9a07fd1ca6779e5852ad9df7" gracePeriod=30
Sep 15 09:16:02.876832 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:02.876808    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:16:03.004256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.004169    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls\") pod \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") "
Sep 15 09:16:03.004256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.004212    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-bound-sa-token\") pod \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") "
Sep 15 09:16:03.004256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.004250    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1433d91-fffc-49fe-b0e7-0ec14fa27689-image-registry-private-configuration\") pod \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") "
Sep 15 09:16:03.004539 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.004296    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1433d91-fffc-49fe-b0e7-0ec14fa27689-trusted-ca\") pod \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") "
Sep 15 09:16:03.004539 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.004345    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1433d91-fffc-49fe-b0e7-0ec14fa27689-installation-pull-secrets\") pod \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") "
Sep 15 09:16:03.004539 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.004448    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1433d91-fffc-49fe-b0e7-0ec14fa27689-ca-trust-extracted\") pod \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") "
Sep 15 09:16:03.004539 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.004523    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-certificates\") pod \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") "
Sep 15 09:16:03.004750 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.004561    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjqv8\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-kube-api-access-pjqv8\") pod \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\" (UID: \"f1433d91-fffc-49fe-b0e7-0ec14fa27689\") "
Sep 15 09:16:03.004908 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.004881    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1433d91-fffc-49fe-b0e7-0ec14fa27689-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f1433d91-fffc-49fe-b0e7-0ec14fa27689" (UID: "f1433d91-fffc-49fe-b0e7-0ec14fa27689"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:16:03.005536 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.005123    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f1433d91-fffc-49fe-b0e7-0ec14fa27689" (UID: "f1433d91-fffc-49fe-b0e7-0ec14fa27689"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:16:03.007466 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.007437    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1433d91-fffc-49fe-b0e7-0ec14fa27689-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f1433d91-fffc-49fe-b0e7-0ec14fa27689" (UID: "f1433d91-fffc-49fe-b0e7-0ec14fa27689"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:16:03.007466 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.007460    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f1433d91-fffc-49fe-b0e7-0ec14fa27689" (UID: "f1433d91-fffc-49fe-b0e7-0ec14fa27689"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:16:03.007617 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.007491    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f1433d91-fffc-49fe-b0e7-0ec14fa27689" (UID: "f1433d91-fffc-49fe-b0e7-0ec14fa27689"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:16:03.007699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.007675    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1433d91-fffc-49fe-b0e7-0ec14fa27689-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f1433d91-fffc-49fe-b0e7-0ec14fa27689" (UID: "f1433d91-fffc-49fe-b0e7-0ec14fa27689"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:16:03.007798 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.007754    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-kube-api-access-pjqv8" (OuterVolumeSpecName: "kube-api-access-pjqv8") pod "f1433d91-fffc-49fe-b0e7-0ec14fa27689" (UID: "f1433d91-fffc-49fe-b0e7-0ec14fa27689"). InnerVolumeSpecName "kube-api-access-pjqv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:16:03.013613 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.013588    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1433d91-fffc-49fe-b0e7-0ec14fa27689-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f1433d91-fffc-49fe-b0e7-0ec14fa27689" (UID: "f1433d91-fffc-49fe-b0e7-0ec14fa27689"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:16:03.105850 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.105821    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1433d91-fffc-49fe-b0e7-0ec14fa27689-installation-pull-secrets\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:16:03.105850 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.105844    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1433d91-fffc-49fe-b0e7-0ec14fa27689-ca-trust-extracted\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:16:03.105850 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.105854    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-certificates\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:16:03.106049 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.105862    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjqv8\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-kube-api-access-pjqv8\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:16:03.106049 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.105871    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-registry-tls\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:16:03.106049 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.105879    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1433d91-fffc-49fe-b0e7-0ec14fa27689-bound-sa-token\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:16:03.106049 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.105888    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1433d91-fffc-49fe-b0e7-0ec14fa27689-image-registry-private-configuration\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:16:03.106049 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.105897    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1433d91-fffc-49fe-b0e7-0ec14fa27689-trusted-ca\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:16:03.724566 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.724529    2575 generic.go:356] "Generic (PLEG): container finished" podID="f1433d91-fffc-49fe-b0e7-0ec14fa27689" containerID="2aa33f2c2e07c5e9d897a30a63c666b89c7008cf9a07fd1ca6779e5852ad9df7" exitCode=0
Sep 15 09:16:03.725051 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.724582    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56ff45949-wvktt"
Sep 15 09:16:03.725051 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.724588    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56ff45949-wvktt" event={"ID":"f1433d91-fffc-49fe-b0e7-0ec14fa27689","Type":"ContainerDied","Data":"2aa33f2c2e07c5e9d897a30a63c666b89c7008cf9a07fd1ca6779e5852ad9df7"}
Sep 15 09:16:03.725051 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.724626    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56ff45949-wvktt" event={"ID":"f1433d91-fffc-49fe-b0e7-0ec14fa27689","Type":"ContainerDied","Data":"1050779562d8a88ebfb46c1b6d56400a329b7756349b0c7059dca4fd8233d530"}
Sep 15 09:16:03.725051 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.724646    2575 scope.go:117] "RemoveContainer" containerID="2aa33f2c2e07c5e9d897a30a63c666b89c7008cf9a07fd1ca6779e5852ad9df7"
Sep 15 09:16:03.733182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.733162    2575 scope.go:117] "RemoveContainer" containerID="2aa33f2c2e07c5e9d897a30a63c666b89c7008cf9a07fd1ca6779e5852ad9df7"
Sep 15 09:16:03.733452 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:16:03.733432    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aa33f2c2e07c5e9d897a30a63c666b89c7008cf9a07fd1ca6779e5852ad9df7\": container with ID starting with 2aa33f2c2e07c5e9d897a30a63c666b89c7008cf9a07fd1ca6779e5852ad9df7 not found: ID does not exist" containerID="2aa33f2c2e07c5e9d897a30a63c666b89c7008cf9a07fd1ca6779e5852ad9df7"
Sep 15 09:16:03.733517 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.733462    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aa33f2c2e07c5e9d897a30a63c666b89c7008cf9a07fd1ca6779e5852ad9df7"} err="failed to get container status \"2aa33f2c2e07c5e9d897a30a63c666b89c7008cf9a07fd1ca6779e5852ad9df7\": rpc error: code = NotFound desc = could not find container \"2aa33f2c2e07c5e9d897a30a63c666b89c7008cf9a07fd1ca6779e5852ad9df7\": container with ID starting with 2aa33f2c2e07c5e9d897a30a63c666b89c7008cf9a07fd1ca6779e5852ad9df7 not found: ID does not exist"
Sep 15 09:16:03.748074 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.748052    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56ff45949-wvktt"]
Sep 15 09:16:03.755822 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.755789    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-56ff45949-wvktt"]
Sep 15 09:16:03.883492 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.883456    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:03.982755 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:03.982680    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:04.037301 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:04.037276    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:04.856917 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:04.856887    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1433d91-fffc-49fe-b0e7-0ec14fa27689" path="/var/lib/kubelet/pods/f1433d91-fffc-49fe-b0e7-0ec14fa27689/volumes"
Sep 15 09:16:05.393364 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:05.393334    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:05.492264 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:05.492239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:06.170007 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:06.169966    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:06.221419 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:06.221387    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:06.636206 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:06.636120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs\") pod \"network-metrics-daemon-2jd2s\" (UID: \"05297e11-2660-4980-a495-baccd89ae99f\") " pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:16:06.638541 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:06.638515    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05297e11-2660-4980-a495-baccd89ae99f-metrics-certs\") pod \"network-metrics-daemon-2jd2s\" (UID: \"05297e11-2660-4980-a495-baccd89ae99f\") " pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:16:06.887787 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:06.887739    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ddxwx\""
Sep 15 09:16:06.895599 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:06.895581    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jd2s"
Sep 15 09:16:07.165404 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:07.165376    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2jd2s"]
Sep 15 09:16:07.167778 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:16:07.167736    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05297e11_2660_4980_a495_baccd89ae99f.slice/crio-22c023cf292e151529842d1ad2f1449a1433f24dd824313da63e5c2355d4b0d0 WatchSource:0}: Error finding container 22c023cf292e151529842d1ad2f1449a1433f24dd824313da63e5c2355d4b0d0: Status 404 returned error can't find the container with id 22c023cf292e151529842d1ad2f1449a1433f24dd824313da63e5c2355d4b0d0
Sep 15 09:16:07.741353 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:07.741321    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jd2s" event={"ID":"05297e11-2660-4980-a495-baccd89ae99f","Type":"ContainerStarted","Data":"22c023cf292e151529842d1ad2f1449a1433f24dd824313da63e5c2355d4b0d0"}
Sep 15 09:16:08.449448 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:08.449412    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:08.520162 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:08.520135    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:08.746838 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:08.746730    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jd2s" event={"ID":"05297e11-2660-4980-a495-baccd89ae99f","Type":"ContainerStarted","Data":"c26c577b9ba26cb2deffc879793fb27028b8b59eac21d4efccc180da448909e6"}
Sep 15 09:16:08.746838 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:08.746803    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jd2s" event={"ID":"05297e11-2660-4980-a495-baccd89ae99f","Type":"ContainerStarted","Data":"ebc1feebcc8cde66a19164787d1119c3437b181d18dded29156a8241e715d4e5"}
Sep 15 09:16:08.762384 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:08.762340    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2jd2s" podStartSLOduration=130.83445834 podStartE2EDuration="2m11.762327334s" totalImagesPullingTime="927.868994ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:08.761349654 +0000 UTC m=+132.410765747" watchObservedRunningTime="2026-09-15 09:16:08.762327334 +0000 UTC m=+132.411743427"
Sep 15 09:16:08.849476 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:08.849446    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:08.914242 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:08.914213    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:11.094687 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:11.094642    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:11.194907 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:11.194873    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:12.277461 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:12.277428    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:12.379594 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:12.379562    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:12.440220 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:12.440183    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:16.780860 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:16.780826    2575 generic.go:356] "Generic (PLEG): container finished" podID="94c76993-536e-4925-990b-8244b58c8879" containerID="74730dce79f9d0ee568ccc745d1545b60708d4a0c2a44465681011741e74badb" exitCode=0
Sep 15 09:16:16.781186 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:16.780893    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg" event={"ID":"94c76993-536e-4925-990b-8244b58c8879","Type":"ContainerDied","Data":"74730dce79f9d0ee568ccc745d1545b60708d4a0c2a44465681011741e74badb"}
Sep 15 09:16:16.781252 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:16.781238    2575 scope.go:117] "RemoveContainer" containerID="74730dce79f9d0ee568ccc745d1545b60708d4a0c2a44465681011741e74badb"
Sep 15 09:16:17.785667 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:17.785635    2575 generic.go:356] "Generic (PLEG): container finished" podID="00e2f7b7-6323-4c32-abe4-5405e244cf0c" containerID="2f6aea5428d249b0032585a6a8a32f311174be01c627061f1bd950323cc217ca" exitCode=0
Sep 15 09:16:17.786123 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:17.785705    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-2wvs2" event={"ID":"00e2f7b7-6323-4c32-abe4-5405e244cf0c","Type":"ContainerDied","Data":"2f6aea5428d249b0032585a6a8a32f311174be01c627061f1bd950323cc217ca"}
Sep 15 09:16:17.786123 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:17.786102    2575 scope.go:117] "RemoveContainer" containerID="2f6aea5428d249b0032585a6a8a32f311174be01c627061f1bd950323cc217ca"
Sep 15 09:16:17.787748 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:17.787729    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xz7jg" event={"ID":"94c76993-536e-4925-990b-8244b58c8879","Type":"ContainerStarted","Data":"22128167e2f9eeca211c97005237b05b238b377efaae2603e5a2f258ffb4ec54"}
Sep 15 09:16:18.792690 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:18.792658    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-2wvs2" event={"ID":"00e2f7b7-6323-4c32-abe4-5405e244cf0c","Type":"ContainerStarted","Data":"fb1ba9ce6a311d9ed6ceafb5ab9439d70f8ce5d11c119fadc2071d0d17c7ff5a"}
Sep 15 09:16:20.844341 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:20.844301    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh" podUID="00db89bc-2f90-477a-9649-cefe1877671c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 15 09:16:24.818446 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:24.818416    2575 generic.go:356] "Generic (PLEG): container finished" podID="187ce716-9a59-4735-9a96-7ee6e614f78e" containerID="9e04984bb90f381bb4b76c4324f98d61eb1db7b05da0191bc386ad2b554edda2" exitCode=0
Sep 15 09:16:24.818795 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:24.818483    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw" event={"ID":"187ce716-9a59-4735-9a96-7ee6e614f78e","Type":"ContainerDied","Data":"9e04984bb90f381bb4b76c4324f98d61eb1db7b05da0191bc386ad2b554edda2"}
Sep 15 09:16:24.818847 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:24.818826    2575 scope.go:117] "RemoveContainer" containerID="9e04984bb90f381bb4b76c4324f98d61eb1db7b05da0191bc386ad2b554edda2"
Sep 15 09:16:25.824158 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:25.824126    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fj8rw" event={"ID":"187ce716-9a59-4735-9a96-7ee6e614f78e","Type":"ContainerStarted","Data":"40e56cf09e13bda44d913f08286fd2f64ab9c29a02e5fb16683ef3d3aaceee94"}
Sep 15 09:16:30.845199 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:30.844795    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh" podUID="00db89bc-2f90-477a-9649-cefe1877671c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 15 09:16:35.395669 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:35.395635    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:35.454148 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:35.454119    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:16:40.844142 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:40.844101    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh" podUID="00db89bc-2f90-477a-9649-cefe1877671c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 15 09:16:40.844502 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:40.844171    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh"
Sep 15 09:16:40.844643 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:40.844625    2575 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"375efebff80201ee9102b0d1c091c8e391ee975fa264af319f1b0c29871ec97f"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 15 09:16:40.844700 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:40.844673    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh" podUID="00db89bc-2f90-477a-9649-cefe1877671c" containerName="service-proxy" containerID="cri-o://375efebff80201ee9102b0d1c091c8e391ee975fa264af319f1b0c29871ec97f" gracePeriod=30
Sep 15 09:16:41.888570 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:41.888540    2575 generic.go:356] "Generic (PLEG): container finished" podID="00db89bc-2f90-477a-9649-cefe1877671c" containerID="375efebff80201ee9102b0d1c091c8e391ee975fa264af319f1b0c29871ec97f" exitCode=2
Sep 15 09:16:41.889097 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:41.888611    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh" event={"ID":"00db89bc-2f90-477a-9649-cefe1877671c","Type":"ContainerDied","Data":"375efebff80201ee9102b0d1c091c8e391ee975fa264af319f1b0c29871ec97f"}
Sep 15 09:16:41.889097 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:16:41.888665    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8696f4c749-5x5vh" event={"ID":"00db89bc-2f90-477a-9649-cefe1877671c","Type":"ContainerStarted","Data":"e6a1ffd6c280a60615b216ae5aa430947e1add20e63587be73c140cf673dca31"}
Sep 15 09:17:06.382381 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:17:06.382344    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:17:06.764810 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:17:06.764781    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:17:15.202651 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:17:15.202620    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:17:15.326616 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:17:15.326585    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:17:15.393086 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:17:15.393055    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:17:16.133665 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:17:16.133629    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:17:16.192034 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:17:16.192007    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:17:26.198345 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:17:26.198311    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:17:26.287844 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:17:26.287810    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:17:26.388326 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:17:26.388296    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:17:48.482498 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:17:48.482460    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:17:48.542111 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:17:48.542075    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:18:13.995225 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:18:13.995183    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:18:21.653358 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:18:21.653321    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:18:21.717312 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:18:21.717279    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:18:22.541202 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:18:22.541169    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:18:22.601419 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:18:22.601377    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:18:33.452888 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:18:33.452851    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:18:33.555170 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:18:33.555139    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:18:33.653856 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:18:33.653826    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:18:38.112978 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:18:38.112949    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:18:50.397979 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:18:50.397944    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:18:50.501656 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:18:50.501629    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:18:56.757998 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:18:56.757972    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:18:56.762788 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:18:56.762741    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:18:56.763699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:18:56.763680    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:18:56.768833 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:18:56.768814    2575 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 09:18:56.768966 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:18:56.768953    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:19:36.721835 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:19:36.721802    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:19:38.745049 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:19:38.745024    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:19:58.236109 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:19:58.236022    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:19:59.038045 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:19:59.038006    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:02.012120 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:02.012090    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:02.140015 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:02.139982    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:03.034650 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:03.034617    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:03.158312 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:03.158276    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:04.126953 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:04.126918    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:04.229146 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:04.229110    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:06.335492 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:06.335463    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:06.522569 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:06.522542    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:08.645872 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:08.645838    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:08.706359 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:08.706330    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:13.847183 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:13.847150    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:13.947280 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:13.947252    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:14.530115 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:14.530087    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:14.642621 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:14.642594    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:14.718780 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:14.718726    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:20.349275 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:20.349241    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:20.449325 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:20.449293    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:22.612345 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:22.612316    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:38.935889 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:38.935858    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:39.057164 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:39.057084    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:40.281383 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:40.281356    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:40.381193 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:40.381160    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:40.824061 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:40.824032    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:41.160537 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.160507    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:41.283274 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.283242    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:41.342826 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.342797    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"]
Sep 15 09:20:41.343155 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.343138    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1433d91-fffc-49fe-b0e7-0ec14fa27689" containerName="registry"
Sep 15 09:20:41.343236 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.343158    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1433d91-fffc-49fe-b0e7-0ec14fa27689" containerName="registry"
Sep 15 09:20:41.343236 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.343230    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1433d91-fffc-49fe-b0e7-0ec14fa27689" containerName="registry"
Sep 15 09:20:41.349743 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.349717    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:41.352585 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.352555    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 09:20:41.352792 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.352635    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 09:20:41.352792 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.352691    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 09:20:41.352792 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.352645    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 09:20:41.352792 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.352723    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d2wz4\""
Sep 15 09:20:41.368148 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.368126    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"]
Sep 15 09:20:41.446209 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.446129    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4dd31bb8-7087-4944-a536-f8354456be9d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-767c4c8b76-spbm4\" (UID: \"4dd31bb8-7087-4944-a536-f8354456be9d\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:41.446209 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.446177    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cdsx\" (UniqueName: \"kubernetes.io/projected/4dd31bb8-7087-4944-a536-f8354456be9d-kube-api-access-8cdsx\") pod \"opendatahub-operator-controller-manager-767c4c8b76-spbm4\" (UID: \"4dd31bb8-7087-4944-a536-f8354456be9d\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:41.446209 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.446194    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dd31bb8-7087-4944-a536-f8354456be9d-tmp\") pod \"opendatahub-operator-controller-manager-767c4c8b76-spbm4\" (UID: \"4dd31bb8-7087-4944-a536-f8354456be9d\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:41.446394 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.446234    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4dd31bb8-7087-4944-a536-f8354456be9d-webhook-cert\") pod \"opendatahub-operator-controller-manager-767c4c8b76-spbm4\" (UID: \"4dd31bb8-7087-4944-a536-f8354456be9d\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:41.446394 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.446268    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4dd31bb8-7087-4944-a536-f8354456be9d-manifests\") pod \"opendatahub-operator-controller-manager-767c4c8b76-spbm4\" (UID: \"4dd31bb8-7087-4944-a536-f8354456be9d\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:41.490706 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.490679    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:41.547585 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.547550    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4dd31bb8-7087-4944-a536-f8354456be9d-manifests\") pod \"opendatahub-operator-controller-manager-767c4c8b76-spbm4\" (UID: \"4dd31bb8-7087-4944-a536-f8354456be9d\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:41.547719 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.547604    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4dd31bb8-7087-4944-a536-f8354456be9d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-767c4c8b76-spbm4\" (UID: \"4dd31bb8-7087-4944-a536-f8354456be9d\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:41.547719 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.547650    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cdsx\" (UniqueName: \"kubernetes.io/projected/4dd31bb8-7087-4944-a536-f8354456be9d-kube-api-access-8cdsx\") pod \"opendatahub-operator-controller-manager-767c4c8b76-spbm4\" (UID: \"4dd31bb8-7087-4944-a536-f8354456be9d\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:41.547719 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.547668    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dd31bb8-7087-4944-a536-f8354456be9d-tmp\") pod \"opendatahub-operator-controller-manager-767c4c8b76-spbm4\" (UID: \"4dd31bb8-7087-4944-a536-f8354456be9d\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:41.547719 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.547689    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4dd31bb8-7087-4944-a536-f8354456be9d-webhook-cert\") pod \"opendatahub-operator-controller-manager-767c4c8b76-spbm4\" (UID: \"4dd31bb8-7087-4944-a536-f8354456be9d\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:41.547989 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.547969    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4dd31bb8-7087-4944-a536-f8354456be9d-manifests\") pod \"opendatahub-operator-controller-manager-767c4c8b76-spbm4\" (UID: \"4dd31bb8-7087-4944-a536-f8354456be9d\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:41.550155 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.550123    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dd31bb8-7087-4944-a536-f8354456be9d-tmp\") pod \"opendatahub-operator-controller-manager-767c4c8b76-spbm4\" (UID: \"4dd31bb8-7087-4944-a536-f8354456be9d\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:41.550335 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.550317    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4dd31bb8-7087-4944-a536-f8354456be9d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-767c4c8b76-spbm4\" (UID: \"4dd31bb8-7087-4944-a536-f8354456be9d\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:41.550386 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.550351    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4dd31bb8-7087-4944-a536-f8354456be9d-webhook-cert\") pod \"opendatahub-operator-controller-manager-767c4c8b76-spbm4\" (UID: \"4dd31bb8-7087-4944-a536-f8354456be9d\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:41.566433 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.566408    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cdsx\" (UniqueName: \"kubernetes.io/projected/4dd31bb8-7087-4944-a536-f8354456be9d-kube-api-access-8cdsx\") pod \"opendatahub-operator-controller-manager-767c4c8b76-spbm4\" (UID: \"4dd31bb8-7087-4944-a536-f8354456be9d\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:41.591789 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.591733    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:41.660263 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.660237    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:41.696700 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.696616    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:41.792318 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.792290    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:41.892453 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.892425    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:41.942069 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.942040    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"]
Sep 15 09:20:41.945358 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:20:41.945338    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd31bb8_7087_4944_a536_f8354456be9d.slice/crio-6e83c696f1bc1c86ec081dcd092e32c53a47ddeb907e6bec658e48a5ccdaf8bc WatchSource:0}: Error finding container 6e83c696f1bc1c86ec081dcd092e32c53a47ddeb907e6bec658e48a5ccdaf8bc: Status 404 returned error can't find the container with id 6e83c696f1bc1c86ec081dcd092e32c53a47ddeb907e6bec658e48a5ccdaf8bc
Sep 15 09:20:41.947301 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:41.947258    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:20:42.002458 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:42.002429    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:42.771058 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:42.771019    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4" event={"ID":"4dd31bb8-7087-4944-a536-f8354456be9d","Type":"ContainerStarted","Data":"6e83c696f1bc1c86ec081dcd092e32c53a47ddeb907e6bec658e48a5ccdaf8bc"}
Sep 15 09:20:45.069236 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:45.069208    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:45.168386 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:45.168357    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:45.785470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:45.785429    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4" event={"ID":"4dd31bb8-7087-4944-a536-f8354456be9d","Type":"ContainerStarted","Data":"e6a3e51bcf6c38bd84e98e7214b317ef4296234ea27643bad50358096d449076"}
Sep 15 09:20:46.791266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:46.791224    2575 generic.go:356] "Generic (PLEG): container finished" podID="4dd31bb8-7087-4944-a536-f8354456be9d" containerID="e6a3e51bcf6c38bd84e98e7214b317ef4296234ea27643bad50358096d449076" exitCode=0
Sep 15 09:20:46.791689 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:46.791282    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4" event={"ID":"4dd31bb8-7087-4944-a536-f8354456be9d","Type":"ContainerDied","Data":"e6a3e51bcf6c38bd84e98e7214b317ef4296234ea27643bad50358096d449076"}
Sep 15 09:20:47.802619 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:47.802581    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4" event={"ID":"4dd31bb8-7087-4944-a536-f8354456be9d","Type":"ContainerStarted","Data":"68c042d5af6c99dea3136394db5a6c489df7008649b852c2ccae4fafe4804dda"}
Sep 15 09:20:47.803061 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:47.802691    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:20:47.824261 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:47.824211    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4" podStartSLOduration=2.164212182 podStartE2EDuration="6.824194593s" totalImagesPullingTime="3.595374723s" totalInitContainerRuntime="1.064607688s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:47.822754576 +0000 UTC m=+411.472170668" watchObservedRunningTime="2026-09-15 09:20:47.824194593 +0000 UTC m=+411.473610686"
Sep 15 09:20:56.062882 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:56.062851    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:56.163048 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:56.163016    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:56.364481 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:56.364403    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:20:58.809714 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:20:58.809678    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-spbm4"
Sep 15 09:21:00.378001 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:00.377967    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:00.483204 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:00.483181    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:00.678819 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:00.678786    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:00.687500 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:00.687474    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6df85cfc68-4l796"]
Sep 15 09:21:00.696564 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:00.696546    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6df85cfc68-4l796"
Sep 15 09:21:00.701648 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:00.701625    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 15 09:21:00.701800 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:00.701641    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 15 09:21:00.706715 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:00.706695    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6df85cfc68-4l796"]
Sep 15 09:21:00.805805 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:00.805778    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7a7c868-50a9-4e91-906c-0884d05de98e-tls-certs\") pod \"kube-auth-proxy-6df85cfc68-4l796\" (UID: \"d7a7c868-50a9-4e91-906c-0884d05de98e\") " pod="openshift-ingress/kube-auth-proxy-6df85cfc68-4l796"
Sep 15 09:21:00.805943 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:00.805825    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7a7c868-50a9-4e91-906c-0884d05de98e-tmp\") pod \"kube-auth-proxy-6df85cfc68-4l796\" (UID: \"d7a7c868-50a9-4e91-906c-0884d05de98e\") " pod="openshift-ingress/kube-auth-proxy-6df85cfc68-4l796"
Sep 15 09:21:00.805943 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:00.805860    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z64bp\" (UniqueName: \"kubernetes.io/projected/d7a7c868-50a9-4e91-906c-0884d05de98e-kube-api-access-z64bp\") pod \"kube-auth-proxy-6df85cfc68-4l796\" (UID: \"d7a7c868-50a9-4e91-906c-0884d05de98e\") " pod="openshift-ingress/kube-auth-proxy-6df85cfc68-4l796"
Sep 15 09:21:00.906427 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:00.906397    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7a7c868-50a9-4e91-906c-0884d05de98e-tmp\") pod \"kube-auth-proxy-6df85cfc68-4l796\" (UID: \"d7a7c868-50a9-4e91-906c-0884d05de98e\") " pod="openshift-ingress/kube-auth-proxy-6df85cfc68-4l796"
Sep 15 09:21:00.906587 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:00.906454    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z64bp\" (UniqueName: \"kubernetes.io/projected/d7a7c868-50a9-4e91-906c-0884d05de98e-kube-api-access-z64bp\") pod \"kube-auth-proxy-6df85cfc68-4l796\" (UID: \"d7a7c868-50a9-4e91-906c-0884d05de98e\") " pod="openshift-ingress/kube-auth-proxy-6df85cfc68-4l796"
Sep 15 09:21:00.906587 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:00.906495    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7a7c868-50a9-4e91-906c-0884d05de98e-tls-certs\") pod \"kube-auth-proxy-6df85cfc68-4l796\" (UID: \"d7a7c868-50a9-4e91-906c-0884d05de98e\") " pod="openshift-ingress/kube-auth-proxy-6df85cfc68-4l796"
Sep 15 09:21:00.906695 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:21:00.906613    2575 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 15 09:21:00.906695 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:21:00.906690    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a7c868-50a9-4e91-906c-0884d05de98e-tls-certs podName:d7a7c868-50a9-4e91-906c-0884d05de98e nodeName:}" failed. No retries permitted until 2026-09-15 09:21:01.406670668 +0000 UTC m=+425.056086745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d7a7c868-50a9-4e91-906c-0884d05de98e-tls-certs") pod "kube-auth-proxy-6df85cfc68-4l796" (UID: "d7a7c868-50a9-4e91-906c-0884d05de98e") : secret "kube-auth-proxy-tls" not found
Sep 15 09:21:00.908781 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:00.908750    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7a7c868-50a9-4e91-906c-0884d05de98e-tmp\") pod \"kube-auth-proxy-6df85cfc68-4l796\" (UID: \"d7a7c868-50a9-4e91-906c-0884d05de98e\") " pod="openshift-ingress/kube-auth-proxy-6df85cfc68-4l796"
Sep 15 09:21:00.917904 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:00.917881    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z64bp\" (UniqueName: \"kubernetes.io/projected/d7a7c868-50a9-4e91-906c-0884d05de98e-kube-api-access-z64bp\") pod \"kube-auth-proxy-6df85cfc68-4l796\" (UID: \"d7a7c868-50a9-4e91-906c-0884d05de98e\") " pod="openshift-ingress/kube-auth-proxy-6df85cfc68-4l796"
Sep 15 09:21:01.215185 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:01.215156    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:01.408687 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:01.408650    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7a7c868-50a9-4e91-906c-0884d05de98e-tls-certs\") pod \"kube-auth-proxy-6df85cfc68-4l796\" (UID: \"d7a7c868-50a9-4e91-906c-0884d05de98e\") " pod="openshift-ingress/kube-auth-proxy-6df85cfc68-4l796"
Sep 15 09:21:01.411170 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:01.411151    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7a7c868-50a9-4e91-906c-0884d05de98e-tls-certs\") pod \"kube-auth-proxy-6df85cfc68-4l796\" (UID: \"d7a7c868-50a9-4e91-906c-0884d05de98e\") " pod="openshift-ingress/kube-auth-proxy-6df85cfc68-4l796"
Sep 15 09:21:01.605923 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:01.605841    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6df85cfc68-4l796"
Sep 15 09:21:01.874679 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:01.874657    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6df85cfc68-4l796"]
Sep 15 09:21:01.877038 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:21:01.877019    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a7c868_50a9_4e91_906c_0884d05de98e.slice/crio-d5918330b8f8c58ed98b4b3f05e270fdbdbb31545892f20bfcea3553035d5ee9 WatchSource:0}: Error finding container d5918330b8f8c58ed98b4b3f05e270fdbdbb31545892f20bfcea3553035d5ee9: Status 404 returned error can't find the container with id d5918330b8f8c58ed98b4b3f05e270fdbdbb31545892f20bfcea3553035d5ee9
Sep 15 09:21:02.026333 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.026308    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:02.032397 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.032374    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"]
Sep 15 09:21:02.035258 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.035243    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.038385 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.038365    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 15 09:21:02.039016 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.038999    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 15 09:21:02.039151 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.039136    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 09:21:02.039328 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.039314    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 15 09:21:02.039401 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.039350    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qnrdb\""
Sep 15 09:21:02.048226 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.048206    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"]
Sep 15 09:21:02.092298 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.092275    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:02.114418 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.114394    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.114519 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.114423    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.114519 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.114445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.114519 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.114492    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.114638 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.114530    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.114638 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.114560    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwbbm\" (UniqueName: \"kubernetes.io/projected/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-kube-api-access-lwbbm\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.114638 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.114605    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.215501 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.215476    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.215590 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.215507    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.215590 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.215527    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.215590 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.215549    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.215590 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.215570    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.215888 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.215604    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwbbm\" (UniqueName: \"kubernetes.io/projected/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-kube-api-access-lwbbm\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.215888 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.215660    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.216230 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.216205    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.218196 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.218175    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.218317 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.218207    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.218317 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.218272    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.218317 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.218293    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.223355 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.223335    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwbbm\" (UniqueName: \"kubernetes.io/projected/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-kube-api-access-lwbbm\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.223736 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.223716    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9rgst\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.344719 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.344685    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:02.617583 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.617554    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"]
Sep 15 09:21:02.619197 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:21:02.619172    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a2c3d09_dc28_4ec8_9fdf_1829c34c9c44.slice/crio-8aeea68e1eceb13267d132c4ef46684274d87208ca1238555b834018d90870c8 WatchSource:0}: Error finding container 8aeea68e1eceb13267d132c4ef46684274d87208ca1238555b834018d90870c8: Status 404 returned error can't find the container with id 8aeea68e1eceb13267d132c4ef46684274d87208ca1238555b834018d90870c8
Sep 15 09:21:02.863564 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.863532    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6df85cfc68-4l796" event={"ID":"d7a7c868-50a9-4e91-906c-0884d05de98e","Type":"ContainerStarted","Data":"d5918330b8f8c58ed98b4b3f05e270fdbdbb31545892f20bfcea3553035d5ee9"}
Sep 15 09:21:02.864981 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.864939    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst" event={"ID":"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44","Type":"ContainerStarted","Data":"8aeea68e1eceb13267d132c4ef46684274d87208ca1238555b834018d90870c8"}
Sep 15 09:21:02.942610 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:02.942557    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:04.877115 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:04.877072    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6df85cfc68-4l796" event={"ID":"d7a7c868-50a9-4e91-906c-0884d05de98e","Type":"ContainerStarted","Data":"9c3c65b8275fde29c7be601c809a9825db1b3c1a6fe5259fe17e7e611f0111db"}
Sep 15 09:21:04.895923 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:04.895729    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6df85cfc68-4l796" podStartSLOduration=2.11478967 podStartE2EDuration="4.895707773s" totalImagesPullingTime="2.780918103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:04.893236224 +0000 UTC m=+428.542652317" watchObservedRunningTime="2026-09-15 09:21:04.895707773 +0000 UTC m=+428.545123866"
Sep 15 09:21:06.451531 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:06.451491    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:21:06.451888 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:06.451558    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:21:06.887692 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:06.887650    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst" event={"ID":"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44","Type":"ContainerStarted","Data":"5c268e1be8a474462ef9df009279bb74f5a3c3d312cf5b22abf804dab867d80c"}
Sep 15 09:21:06.887869 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:06.887726    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:06.908136 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:06.908090    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst" podStartSLOduration=1.078624555 podStartE2EDuration="4.908061559s" totalImagesPullingTime="3.829437004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:06.905660226 +0000 UTC m=+430.555076320" watchObservedRunningTime="2026-09-15 09:21:06.908061559 +0000 UTC m=+430.557477651"
Sep 15 09:21:07.305929 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:07.305819    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:07.365930 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:07.365874    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:07.879060 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:07.879032    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:07.893223 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:07.893194    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:07.975963 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:07.975933    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:08.084430 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:08.084390    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:11.454155 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:11.454121    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:11.584083 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:11.584038    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:11.732198 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:11.732115    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:11.860805 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:11.860753    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:12.253168 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:12.253105    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:12.742329 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:12.742296    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:20.716004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.715974    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:20.763076 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.763042    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7trbv"]
Sep 15 09:21:20.766249 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.766228    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7trbv"
Sep 15 09:21:20.770574 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.770551    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 15 09:21:20.770669 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.770551    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-xzfsm\""
Sep 15 09:21:20.778424 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.778403    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7trbv"]
Sep 15 09:21:20.781236 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.781218    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xgr86"]
Sep 15 09:21:20.784228 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.784212    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xgr86"
Sep 15 09:21:20.786620 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.786603    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 15 09:21:20.787071 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.787057    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wtdcf\""
Sep 15 09:21:20.803436 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.803409    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xgr86"]
Sep 15 09:21:20.819734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.819708    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:20.872724 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.872692    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac-cert\") pod \"kserve-controller-manager-d6f4b65b8-7trbv\" (UID: \"2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7trbv"
Sep 15 09:21:20.872724 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.872725    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/431f5053-0f35-4cb5-920f-848f2a7d9292-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xgr86\" (UID: \"431f5053-0f35-4cb5-920f-848f2a7d9292\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xgr86"
Sep 15 09:21:20.872941 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.872876    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksdxb\" (UniqueName: \"kubernetes.io/projected/2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac-kube-api-access-ksdxb\") pod \"kserve-controller-manager-d6f4b65b8-7trbv\" (UID: \"2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7trbv"
Sep 15 09:21:20.872941 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.872922    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp8fn\" (UniqueName: \"kubernetes.io/projected/431f5053-0f35-4cb5-920f-848f2a7d9292-kube-api-access-xp8fn\") pod \"llmisvc-controller-manager-777c6bd7d5-xgr86\" (UID: \"431f5053-0f35-4cb5-920f-848f2a7d9292\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xgr86"
Sep 15 09:21:20.974062 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.973977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac-cert\") pod \"kserve-controller-manager-d6f4b65b8-7trbv\" (UID: \"2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7trbv"
Sep 15 09:21:20.974062 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.974008    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/431f5053-0f35-4cb5-920f-848f2a7d9292-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xgr86\" (UID: \"431f5053-0f35-4cb5-920f-848f2a7d9292\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xgr86"
Sep 15 09:21:20.974062 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.974053    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksdxb\" (UniqueName: \"kubernetes.io/projected/2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac-kube-api-access-ksdxb\") pod \"kserve-controller-manager-d6f4b65b8-7trbv\" (UID: \"2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7trbv"
Sep 15 09:21:20.974316 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.974072    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp8fn\" (UniqueName: \"kubernetes.io/projected/431f5053-0f35-4cb5-920f-848f2a7d9292-kube-api-access-xp8fn\") pod \"llmisvc-controller-manager-777c6bd7d5-xgr86\" (UID: \"431f5053-0f35-4cb5-920f-848f2a7d9292\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xgr86"
Sep 15 09:21:20.974316 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:21:20.974156    2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 15 09:21:20.974316 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:21:20.974186    2575 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 15 09:21:20.974316 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:21:20.974234    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac-cert podName:2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac nodeName:}" failed. No retries permitted until 2026-09-15 09:21:21.474214119 +0000 UTC m=+445.123630193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac-cert") pod "kserve-controller-manager-d6f4b65b8-7trbv" (UID: "2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac") : secret "kserve-webhook-server-cert" not found
Sep 15 09:21:20.974316 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:21:20.974254    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/431f5053-0f35-4cb5-920f-848f2a7d9292-cert podName:431f5053-0f35-4cb5-920f-848f2a7d9292 nodeName:}" failed. No retries permitted until 2026-09-15 09:21:21.474244026 +0000 UTC m=+445.123660103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/431f5053-0f35-4cb5-920f-848f2a7d9292-cert") pod "llmisvc-controller-manager-777c6bd7d5-xgr86" (UID: "431f5053-0f35-4cb5-920f-848f2a7d9292") : secret "llmisvc-webhook-server-cert" not found
Sep 15 09:21:20.999718 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:20.999692    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp8fn\" (UniqueName: \"kubernetes.io/projected/431f5053-0f35-4cb5-920f-848f2a7d9292-kube-api-access-xp8fn\") pod \"llmisvc-controller-manager-777c6bd7d5-xgr86\" (UID: \"431f5053-0f35-4cb5-920f-848f2a7d9292\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xgr86"
Sep 15 09:21:21.002758 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:21.002733    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksdxb\" (UniqueName: \"kubernetes.io/projected/2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac-kube-api-access-ksdxb\") pod \"kserve-controller-manager-d6f4b65b8-7trbv\" (UID: \"2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7trbv"
Sep 15 09:21:21.085123 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:21.085094    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:21.192929 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:21.192896    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:21.293828 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:21.293733    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:21.400866 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:21.400838    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:21.478652 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:21.478623    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac-cert\") pod \"kserve-controller-manager-d6f4b65b8-7trbv\" (UID: \"2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7trbv"
Sep 15 09:21:21.478652 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:21.478655    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/431f5053-0f35-4cb5-920f-848f2a7d9292-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xgr86\" (UID: \"431f5053-0f35-4cb5-920f-848f2a7d9292\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xgr86"
Sep 15 09:21:21.481237 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:21.481216    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/431f5053-0f35-4cb5-920f-848f2a7d9292-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xgr86\" (UID: \"431f5053-0f35-4cb5-920f-848f2a7d9292\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xgr86"
Sep 15 09:21:21.481340 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:21.481272    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac-cert\") pod \"kserve-controller-manager-d6f4b65b8-7trbv\" (UID: \"2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7trbv"
Sep 15 09:21:21.676731 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:21.676702    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7trbv"
Sep 15 09:21:21.696455 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:21.696423    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xgr86"
Sep 15 09:21:21.966369 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:21.966342    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7trbv"]
Sep 15 09:21:21.969688 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:21:21.969661    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d5bfe75_40dc_4f94_8fb7_d6ce5327fcac.slice/crio-8e8876d4e6d1fe92a91dd10b399e08491e446b85c4d76c643137c09076cc8e0b WatchSource:0}: Error finding container 8e8876d4e6d1fe92a91dd10b399e08491e446b85c4d76c643137c09076cc8e0b: Status 404 returned error can't find the container with id 8e8876d4e6d1fe92a91dd10b399e08491e446b85c4d76c643137c09076cc8e0b
Sep 15 09:21:21.994606 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:21:21.994581    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod431f5053_0f35_4cb5_920f_848f2a7d9292.slice/crio-655fe804d0784b818971940de2b8092968a1741721750a10cf0d33b88e79996d WatchSource:0}: Error finding container 655fe804d0784b818971940de2b8092968a1741721750a10cf0d33b88e79996d: Status 404 returned error can't find the container with id 655fe804d0784b818971940de2b8092968a1741721750a10cf0d33b88e79996d
Sep 15 09:21:21.994871 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:21.994851    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xgr86"]
Sep 15 09:21:22.107821 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.107790    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"]
Sep 15 09:21:22.108017 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.107996    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst" podUID="1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44" containerName="discovery" containerID="cri-o://5c268e1be8a474462ef9df009279bb74f5a3c3d312cf5b22abf804dab867d80c" gracePeriod=30
Sep 15 09:21:22.346680 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.346657    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:22.488045 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.487962    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-local-certs\") pod \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") "
Sep 15 09:21:22.488045 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.488008    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-csr-dns-cert\") pod \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") "
Sep 15 09:21:22.488045 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.488025    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-cacerts\") pod \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") "
Sep 15 09:21:22.488316 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.488065    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-token\") pod \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") "
Sep 15 09:21:22.488316 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.488112    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-kubeconfig\") pod \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") "
Sep 15 09:21:22.488316 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.488140    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-csr-ca-configmap\") pod \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") "
Sep 15 09:21:22.488316 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.488174    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwbbm\" (UniqueName: \"kubernetes.io/projected/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-kube-api-access-lwbbm\") pod \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\" (UID: \"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44\") "
Sep 15 09:21:22.488599 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.488566    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44" (UID: "1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:21:22.490652 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.490617    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-local-certs" (OuterVolumeSpecName: "local-certs") pod "1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44" (UID: "1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:21:22.490652 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.490617    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44" (UID: "1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:21:22.490854 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.490757    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-cacerts" (OuterVolumeSpecName: "cacerts") pod "1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44" (UID: "1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:21:22.490907 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.490856    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-token" (OuterVolumeSpecName: "istio-token") pod "1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44" (UID: "1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:21:22.491198 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.491173    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44" (UID: "1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:21:22.491320 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.491297    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-kube-api-access-lwbbm" (OuterVolumeSpecName: "kube-api-access-lwbbm") pod "1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44" (UID: "1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44"). InnerVolumeSpecName "kube-api-access-lwbbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:21:22.589071 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.589043    2575 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-local-certs\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:21:22.589071 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.589066    2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-csr-dns-cert\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:21:22.589071 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.589075    2575 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-cacerts\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:21:22.589277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.589083    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-token\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:21:22.589277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.589090    2575 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-kubeconfig\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:21:22.589277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.589097    2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-istio-csr-ca-configmap\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:21:22.589277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.589105    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwbbm\" (UniqueName: \"kubernetes.io/projected/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44-kube-api-access-lwbbm\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:21:22.751831 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.751741    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:21:22.959301 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.959266    2575 generic.go:356] "Generic (PLEG): container finished" podID="1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44" containerID="5c268e1be8a474462ef9df009279bb74f5a3c3d312cf5b22abf804dab867d80c" exitCode=0
Sep 15 09:21:22.959476 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.959309    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"
Sep 15 09:21:22.959476 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.959362    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst" event={"ID":"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44","Type":"ContainerDied","Data":"5c268e1be8a474462ef9df009279bb74f5a3c3d312cf5b22abf804dab867d80c"}
Sep 15 09:21:22.959476 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.959407    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst" event={"ID":"1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44","Type":"ContainerDied","Data":"8aeea68e1eceb13267d132c4ef46684274d87208ca1238555b834018d90870c8"}
Sep 15 09:21:22.959476 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.959431    2575 scope.go:117] "RemoveContainer" containerID="5c268e1be8a474462ef9df009279bb74f5a3c3d312cf5b22abf804dab867d80c"
Sep 15 09:21:22.961758 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.961606    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xgr86" event={"ID":"431f5053-0f35-4cb5-920f-848f2a7d9292","Type":"ContainerStarted","Data":"655fe804d0784b818971940de2b8092968a1741721750a10cf0d33b88e79996d"}
Sep 15 09:21:22.963616 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.963557    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7trbv" event={"ID":"2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac","Type":"ContainerStarted","Data":"8e8876d4e6d1fe92a91dd10b399e08491e446b85c4d76c643137c09076cc8e0b"}
Sep 15 09:21:22.992260 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:22.992224    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"]
Sep 15 09:21:23.007804 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:23.007727    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rgst"]
Sep 15 09:21:23.061549 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:23.061521    2575 scope.go:117] "RemoveContainer" containerID="5c268e1be8a474462ef9df009279bb74f5a3c3d312cf5b22abf804dab867d80c"
Sep 15 09:21:23.062000 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:21:23.061965    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c268e1be8a474462ef9df009279bb74f5a3c3d312cf5b22abf804dab867d80c\": container with ID starting with 5c268e1be8a474462ef9df009279bb74f5a3c3d312cf5b22abf804dab867d80c not found: ID does not exist" containerID="5c268e1be8a474462ef9df009279bb74f5a3c3d312cf5b22abf804dab867d80c"
Sep 15 09:21:23.062113 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:23.062009    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c268e1be8a474462ef9df009279bb74f5a3c3d312cf5b22abf804dab867d80c"} err="failed to get container status \"5c268e1be8a474462ef9df009279bb74f5a3c3d312cf5b22abf804dab867d80c\": rpc error: code = NotFound desc = could not find container \"5c268e1be8a474462ef9df009279bb74f5a3c3d312cf5b22abf804dab867d80c\": container with ID starting with 5c268e1be8a474462ef9df009279bb74f5a3c3d312cf5b22abf804dab867d80c not found: ID does not exist"
Sep 15 09:21:24.859458 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:24.859422    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44" path="/var/lib/kubelet/pods/1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44/volumes"
Sep 15 09:21:25.980747 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:25.980714    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7trbv" event={"ID":"2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac","Type":"ContainerStarted","Data":"945b235021932b1aa6dfacc25a510ba07d5320cb0203ffa5e18d1d430a257cfc"}
Sep 15 09:21:25.981215 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:25.980906    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7trbv"
Sep 15 09:21:25.982292 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:25.982258    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xgr86" event={"ID":"431f5053-0f35-4cb5-920f-848f2a7d9292","Type":"ContainerStarted","Data":"b603c595815431c8a05a75b3602430414b98b99dcd25f6bf5b6d5e87e2214d7e"}
Sep 15 09:21:25.982439 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:25.982379    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xgr86"
Sep 15 09:21:26.001696 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:26.001651    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7trbv" podStartSLOduration=2.96243004 podStartE2EDuration="6.001637697s" totalImagesPullingTime="3.039207657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:26.000797976 +0000 UTC m=+449.650214065" watchObservedRunningTime="2026-09-15 09:21:26.001637697 +0000 UTC m=+449.651053817"
Sep 15 09:21:26.024388 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:26.024345    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xgr86" podStartSLOduration=3.006780027 podStartE2EDuration="6.024330515s" totalImagesPullingTime="3.017550488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:26.022372754 +0000 UTC m=+449.671788846" watchObservedRunningTime="2026-09-15 09:21:26.024330515 +0000 UTC m=+449.673746607"
Sep 15 09:21:56.988652 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:56.988620    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xgr86"
Sep 15 09:21:56.991561 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:21:56.991544    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7trbv"
Sep 15 09:22:12.772473 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:12.772437    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:12.868639 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:12.868604    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:24.348658 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:24.348623    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:27.730045 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:27.730010    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:29.679720 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:29.679684    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:37.900503 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:37.900473    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:38.753626 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:38.753590    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:39.506038 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:39.506005    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:41.752065 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:41.752033    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:42.434119 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:42.434091    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"]
Sep 15 09:22:42.434395 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:42.434384    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44" containerName="discovery"
Sep 15 09:22:42.434450 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:42.434397    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44" containerName="discovery"
Sep 15 09:22:42.434487 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:42.434455    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a2c3d09-dc28-4ec8-9fdf-1829c34c9c44" containerName="discovery"
Sep 15 09:22:42.437476 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:42.437461    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"
Sep 15 09:22:42.441379 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:42.441358    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 15 09:22:42.441504 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:42.441359    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 15 09:22:42.441504 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:42.441399    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2rwrt\""
Sep 15 09:22:42.453520 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:42.453501    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"]
Sep 15 09:22:42.517782 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:42.517738    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqrkn\" (UniqueName: \"kubernetes.io/projected/dcebccd2-3723-4103-81e0-8bec562f3cbc-kube-api-access-jqrkn\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n76v9\" (UID: \"dcebccd2-3723-4103-81e0-8bec562f3cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"
Sep 15 09:22:42.517937 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:42.517812    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcebccd2-3723-4103-81e0-8bec562f3cbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n76v9\" (UID: \"dcebccd2-3723-4103-81e0-8bec562f3cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"
Sep 15 09:22:42.619120 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:42.619085    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqrkn\" (UniqueName: \"kubernetes.io/projected/dcebccd2-3723-4103-81e0-8bec562f3cbc-kube-api-access-jqrkn\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n76v9\" (UID: \"dcebccd2-3723-4103-81e0-8bec562f3cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"
Sep 15 09:22:42.619283 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:42.619140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcebccd2-3723-4103-81e0-8bec562f3cbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n76v9\" (UID: \"dcebccd2-3723-4103-81e0-8bec562f3cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"
Sep 15 09:22:42.619470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:42.619449    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcebccd2-3723-4103-81e0-8bec562f3cbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n76v9\" (UID: \"dcebccd2-3723-4103-81e0-8bec562f3cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"
Sep 15 09:22:42.627284 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:42.627262    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqrkn\" (UniqueName: \"kubernetes.io/projected/dcebccd2-3723-4103-81e0-8bec562f3cbc-kube-api-access-jqrkn\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n76v9\" (UID: \"dcebccd2-3723-4103-81e0-8bec562f3cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"
Sep 15 09:22:42.700597 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:42.700519    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:42.747976 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:42.747938    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"
Sep 15 09:22:43.024450 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:43.024379    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"]
Sep 15 09:22:43.027458 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:22:43.027430    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcebccd2_3723_4103_81e0_8bec562f3cbc.slice/crio-ccd5ce816aee8b086e14bec0069ad4522f9446d9983bd504b0195bc48fb3f76b WatchSource:0}: Error finding container ccd5ce816aee8b086e14bec0069ad4522f9446d9983bd504b0195bc48fb3f76b: Status 404 returned error can't find the container with id ccd5ce816aee8b086e14bec0069ad4522f9446d9983bd504b0195bc48fb3f76b
Sep 15 09:22:43.147061 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:43.147030    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:43.303954 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:43.303871    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9" event={"ID":"dcebccd2-3723-4103-81e0-8bec562f3cbc","Type":"ContainerStarted","Data":"ccd5ce816aee8b086e14bec0069ad4522f9446d9983bd504b0195bc48fb3f76b"}
Sep 15 09:22:43.336826 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:43.336783    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:43.436882 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:43.436856    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:45.044625 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:45.044583    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-vdj8k"]
Sep 15 09:22:45.055523 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:45.055488    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-vdj8k"
Sep 15 09:22:45.058697 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:45.058537    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-vdj8k"]
Sep 15 09:22:45.058697 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:45.058577    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wqpcn\""
Sep 15 09:22:45.142044 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:45.141977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22rrc\" (UniqueName: \"kubernetes.io/projected/94c16614-2426-4abf-bf94-fb8ceedeba8c-kube-api-access-22rrc\") pod \"authorino-operator-76b478bd78-vdj8k\" (UID: \"94c16614-2426-4abf-bf94-fb8ceedeba8c\") " pod="kuadrant-system/authorino-operator-76b478bd78-vdj8k"
Sep 15 09:22:45.243673 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:45.243627    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22rrc\" (UniqueName: \"kubernetes.io/projected/94c16614-2426-4abf-bf94-fb8ceedeba8c-kube-api-access-22rrc\") pod \"authorino-operator-76b478bd78-vdj8k\" (UID: \"94c16614-2426-4abf-bf94-fb8ceedeba8c\") " pod="kuadrant-system/authorino-operator-76b478bd78-vdj8k"
Sep 15 09:22:45.257263 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:45.257225    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22rrc\" (UniqueName: \"kubernetes.io/projected/94c16614-2426-4abf-bf94-fb8ceedeba8c-kube-api-access-22rrc\") pod \"authorino-operator-76b478bd78-vdj8k\" (UID: \"94c16614-2426-4abf-bf94-fb8ceedeba8c\") " pod="kuadrant-system/authorino-operator-76b478bd78-vdj8k"
Sep 15 09:22:45.370625 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:45.370517    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-vdj8k"
Sep 15 09:22:45.661368 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:45.661308    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-vdj8k"]
Sep 15 09:22:45.714638 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:45.714598    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:45.816808 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:45.816749    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:46.868880 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:22:46.868848    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c16614_2426_4abf_bf94_fb8ceedeba8c.slice/crio-dee8af56357fa6b49c26cebdde425bb8a29dc687effdcdbbb96c57d26e32d179 WatchSource:0}: Error finding container dee8af56357fa6b49c26cebdde425bb8a29dc687effdcdbbb96c57d26e32d179: Status 404 returned error can't find the container with id dee8af56357fa6b49c26cebdde425bb8a29dc687effdcdbbb96c57d26e32d179
Sep 15 09:22:47.313191 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:47.313156    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw"]
Sep 15 09:22:47.316337 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:47.316319    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw"
Sep 15 09:22:47.319012 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:47.318986    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zshnx\""
Sep 15 09:22:47.325348 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:47.325310    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw"]
Sep 15 09:22:47.330539 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:47.330423    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-vdj8k" event={"ID":"94c16614-2426-4abf-bf94-fb8ceedeba8c","Type":"ContainerStarted","Data":"dee8af56357fa6b49c26cebdde425bb8a29dc687effdcdbbb96c57d26e32d179"}
Sep 15 09:22:47.332460 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:47.332425    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9" event={"ID":"dcebccd2-3723-4103-81e0-8bec562f3cbc","Type":"ContainerStarted","Data":"b579e069448429e1b72622b7309ecfbf2092885893d8d71c00e3dfd6d4d9c220"}
Sep 15 09:22:47.332625 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:47.332609    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"
Sep 15 09:22:47.361408 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:47.361360    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9" podStartSLOduration=1.450911351 podStartE2EDuration="5.361341551s" totalImagesPullingTime="3.9104302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:22:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:22:47.359499509 +0000 UTC m=+531.008915604" watchObservedRunningTime="2026-09-15 09:22:47.361341551 +0000 UTC m=+531.010757637"
Sep 15 09:22:47.361588 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:47.361572    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pmkf\" (UniqueName: \"kubernetes.io/projected/89fa51e1-d457-499b-81ae-e46d6887b59b-kube-api-access-6pmkf\") pod \"limitador-operator-controller-manager-74495c69f8-h6gdw\" (UID: \"89fa51e1-d457-499b-81ae-e46d6887b59b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw"
Sep 15 09:22:47.462508 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:47.462465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pmkf\" (UniqueName: \"kubernetes.io/projected/89fa51e1-d457-499b-81ae-e46d6887b59b-kube-api-access-6pmkf\") pod \"limitador-operator-controller-manager-74495c69f8-h6gdw\" (UID: \"89fa51e1-d457-499b-81ae-e46d6887b59b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw"
Sep 15 09:22:47.473252 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:47.473226    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pmkf\" (UniqueName: \"kubernetes.io/projected/89fa51e1-d457-499b-81ae-e46d6887b59b-kube-api-access-6pmkf\") pod \"limitador-operator-controller-manager-74495c69f8-h6gdw\" (UID: \"89fa51e1-d457-499b-81ae-e46d6887b59b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw"
Sep 15 09:22:47.628170 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:47.628076    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw"
Sep 15 09:22:47.909621 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:47.909449    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw"]
Sep 15 09:22:47.912052 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:22:47.912025    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89fa51e1_d457_499b_81ae_e46d6887b59b.slice/crio-c1d872a0ab5b786c1bbf9f1d887fd088cb576344c8a728290e0c2fb1d8e2eefd WatchSource:0}: Error finding container c1d872a0ab5b786c1bbf9f1d887fd088cb576344c8a728290e0c2fb1d8e2eefd: Status 404 returned error can't find the container with id c1d872a0ab5b786c1bbf9f1d887fd088cb576344c8a728290e0c2fb1d8e2eefd
Sep 15 09:22:47.915252 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:47.915230    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:48.134792 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:48.134739    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:48.344794 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:48.344672    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw" event={"ID":"89fa51e1-d457-499b-81ae-e46d6887b59b","Type":"ContainerStarted","Data":"c1d872a0ab5b786c1bbf9f1d887fd088cb576344c8a728290e0c2fb1d8e2eefd"}
Sep 15 09:22:49.810027 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:49.809990    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:50.050052 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:50.050020    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:50.356791 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:50.356742    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw" event={"ID":"89fa51e1-d457-499b-81ae-e46d6887b59b","Type":"ContainerStarted","Data":"c3dd7cdd8cb9de2fe7f3e5612ea4c0dd7333845322d21ed0b33335e68317f3f8"}
Sep 15 09:22:50.356963 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:50.356890    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw"
Sep 15 09:22:50.377449 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:50.377386    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw" podStartSLOduration=1.465433822 podStartE2EDuration="3.377366446s" totalImagesPullingTime="1.911932624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:22:50.375724473 +0000 UTC m=+534.025140567" watchObservedRunningTime="2026-09-15 09:22:50.377366446 +0000 UTC m=+534.026782542"
Sep 15 09:22:51.363149 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:51.363056    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-vdj8k" event={"ID":"94c16614-2426-4abf-bf94-fb8ceedeba8c","Type":"ContainerStarted","Data":"36ceca41e76ccf472b0a1cf0bddedd53ad94d1e7f327befea660a21f9ae8508f"}
Sep 15 09:22:51.379596 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:51.379497    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-vdj8k" podStartSLOduration=2.24419862 podStartE2EDuration="6.379477108s" totalImagesPullingTime="4.135278488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:22:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:22:51.379007869 +0000 UTC m=+535.028423981" watchObservedRunningTime="2026-09-15 09:22:51.379477108 +0000 UTC m=+535.028893203"
Sep 15 09:22:52.368628 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:52.368598    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-vdj8k"
Sep 15 09:22:52.701031 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:52.700998    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:52.801400 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:52.801352    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:53.105282 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:53.105183    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:53.205515 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:53.205482    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:53.506240 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:53.506199    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:53.606873 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:53.606836    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:58.347919 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:58.347883    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"
Sep 15 09:22:59.830015 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:59.829979    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:22:59.932396 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:22:59.932358    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:00.091343 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.091263    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"]
Sep 15 09:23:00.094849 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.094831    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"
Sep 15 09:23:00.106659 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.106623    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"]
Sep 15 09:23:00.182532 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.182494    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cnrl\" (UniqueName: \"kubernetes.io/projected/e377ec8b-a310-46e7-8474-fdf0982fbfcc-kube-api-access-5cnrl\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-b8b49\" (UID: \"e377ec8b-a310-46e7-8474-fdf0982fbfcc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"
Sep 15 09:23:00.182710 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.182561    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e377ec8b-a310-46e7-8474-fdf0982fbfcc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-b8b49\" (UID: \"e377ec8b-a310-46e7-8474-fdf0982fbfcc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"
Sep 15 09:23:00.283152 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.283108    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cnrl\" (UniqueName: \"kubernetes.io/projected/e377ec8b-a310-46e7-8474-fdf0982fbfcc-kube-api-access-5cnrl\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-b8b49\" (UID: \"e377ec8b-a310-46e7-8474-fdf0982fbfcc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"
Sep 15 09:23:00.283338 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.283195    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e377ec8b-a310-46e7-8474-fdf0982fbfcc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-b8b49\" (UID: \"e377ec8b-a310-46e7-8474-fdf0982fbfcc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"
Sep 15 09:23:00.283612 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.283589    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e377ec8b-a310-46e7-8474-fdf0982fbfcc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-b8b49\" (UID: \"e377ec8b-a310-46e7-8474-fdf0982fbfcc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"
Sep 15 09:23:00.291323 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.291287    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cnrl\" (UniqueName: \"kubernetes.io/projected/e377ec8b-a310-46e7-8474-fdf0982fbfcc-kube-api-access-5cnrl\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-b8b49\" (UID: \"e377ec8b-a310-46e7-8474-fdf0982fbfcc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"
Sep 15 09:23:00.405156 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.405124    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"
Sep 15 09:23:00.552900 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.552858    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"]
Sep 15 09:23:00.553204 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.553159    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9" podUID="dcebccd2-3723-4103-81e0-8bec562f3cbc" containerName="manager" containerID="cri-o://b579e069448429e1b72622b7309ecfbf2092885893d8d71c00e3dfd6d4d9c220" gracePeriod=2
Sep 15 09:23:00.555308 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:23:00.555264    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n76v9\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="dcebccd2-3723-4103-81e0-8bec562f3cbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"
Sep 15 09:23:00.557926 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.557872    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"]
Sep 15 09:23:00.565920 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.565885    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"]
Sep 15 09:23:00.576467 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.576441    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"]
Sep 15 09:23:00.576899 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.576873    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcebccd2-3723-4103-81e0-8bec562f3cbc" containerName="manager"
Sep 15 09:23:00.576899 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.576891    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcebccd2-3723-4103-81e0-8bec562f3cbc" containerName="manager"
Sep 15 09:23:00.577058 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.577001    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcebccd2-3723-4103-81e0-8bec562f3cbc" containerName="manager"
Sep 15 09:23:00.580854 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.580811    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"
Sep 15 09:23:00.581055 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.581032    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"]
Sep 15 09:23:00.583208 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:23:00.583176    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n76v9\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="dcebccd2-3723-4103-81e0-8bec562f3cbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"
Sep 15 09:23:00.591305 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.591271    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw"]
Sep 15 09:23:00.591596 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.591557    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw" podUID="89fa51e1-d457-499b-81ae-e46d6887b59b" containerName="manager" containerID="cri-o://c3dd7cdd8cb9de2fe7f3e5612ea4c0dd7333845322d21ed0b33335e68317f3f8" gracePeriod=2
Sep 15 09:23:00.595102 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.594985    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw"
Sep 15 09:23:00.595102 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.595079    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"]
Sep 15 09:23:00.600709 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.600576    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw"]
Sep 15 09:23:00.616879 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.616844    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-v4k4g"]
Sep 15 09:23:00.617371 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.617355    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89fa51e1-d457-499b-81ae-e46d6887b59b" containerName="manager"
Sep 15 09:23:00.617439 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.617377    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="89fa51e1-d457-499b-81ae-e46d6887b59b" containerName="manager"
Sep 15 09:23:00.617489 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.617466    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="89fa51e1-d457-499b-81ae-e46d6887b59b" containerName="manager"
Sep 15 09:23:00.620733 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.620706    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v4k4g"
Sep 15 09:23:00.637075 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:23:00.637032    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-h6gdw\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="89fa51e1-d457-499b-81ae-e46d6887b59b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw"
Sep 15 09:23:00.638666 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.638636    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-v4k4g"]
Sep 15 09:23:00.656662 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:23:00.656591    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n76v9\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="dcebccd2-3723-4103-81e0-8bec562f3cbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"
Sep 15 09:23:00.687516 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.687491    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbbd7\" (UniqueName: \"kubernetes.io/projected/6f5a6f4b-7dcf-4cea-b670-c8185975aa3e-kube-api-access-rbbd7\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8m7vb\" (UID: \"6f5a6f4b-7dcf-4cea-b670-c8185975aa3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"
Sep 15 09:23:00.687643 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.687527    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f5a6f4b-7dcf-4cea-b670-c8185975aa3e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8m7vb\" (UID: \"6f5a6f4b-7dcf-4cea-b670-c8185975aa3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"
Sep 15 09:23:00.788280 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.788243    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbbd7\" (UniqueName: \"kubernetes.io/projected/6f5a6f4b-7dcf-4cea-b670-c8185975aa3e-kube-api-access-rbbd7\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8m7vb\" (UID: \"6f5a6f4b-7dcf-4cea-b670-c8185975aa3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"
Sep 15 09:23:00.788442 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.788293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z9hc\" (UniqueName: \"kubernetes.io/projected/38567e1e-1f7e-4819-9f8c-f1d4d6de10ef-kube-api-access-7z9hc\") pod \"limitador-operator-controller-manager-74495c69f8-v4k4g\" (UID: \"38567e1e-1f7e-4819-9f8c-f1d4d6de10ef\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v4k4g"
Sep 15 09:23:00.788442 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.788326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f5a6f4b-7dcf-4cea-b670-c8185975aa3e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8m7vb\" (UID: \"6f5a6f4b-7dcf-4cea-b670-c8185975aa3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"
Sep 15 09:23:00.788782 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.788747    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f5a6f4b-7dcf-4cea-b670-c8185975aa3e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8m7vb\" (UID: \"6f5a6f4b-7dcf-4cea-b670-c8185975aa3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"
Sep 15 09:23:00.797399 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.797318    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbbd7\" (UniqueName: \"kubernetes.io/projected/6f5a6f4b-7dcf-4cea-b670-c8185975aa3e-kube-api-access-rbbd7\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8m7vb\" (UID: \"6f5a6f4b-7dcf-4cea-b670-c8185975aa3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"
Sep 15 09:23:00.812271 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:23:00.812232    2575 log.go:32] "RunPodSandbox from runtime service failed" err=<
Sep 15 09:23:00.812271 ip-10-0-136-31 kubenswrapper[2575]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-b8b49_kuadrant-system_e377ec8b-a310-46e7-8474-fdf0982fbfcc_0(3cb147dcc50c058481f950f78aa24fe6698515c4389956bd717e0fb33354d6a8): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-b8b49 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3cb147dcc50c058481f950f78aa24fe6698515c4389956bd717e0fb33354d6a8" Netns:"/var/run/netns/10f1353f-22b6-4620-b3a7-e7f240c56b4f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-b8b49;K8S_POD_INFRA_CONTAINER_ID=3cb147dcc50c058481f950f78aa24fe6698515c4389956bd717e0fb33354d6a8;K8S_POD_UID=e377ec8b-a310-46e7-8474-fdf0982fbfcc" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49/e377ec8b-a310-46e7-8474-fdf0982fbfcc:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49 3cb147dcc50c058481f950f78aa24fe6698515c4389956bd717e0fb33354d6a8 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:1e [10.133.0.30/23]
Sep 15 09:23:00.812271 ip-10-0-136-31 kubenswrapper[2575]:         '
Sep 15 09:23:00.812271 ip-10-0-136-31 kubenswrapper[2575]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 15 09:23:00.812271 ip-10-0-136-31 kubenswrapper[2575]:  >
Sep 15 09:23:00.812452 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:23:00.812311    2575 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Sep 15 09:23:00.812452 ip-10-0-136-31 kubenswrapper[2575]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-b8b49_kuadrant-system_e377ec8b-a310-46e7-8474-fdf0982fbfcc_0(3cb147dcc50c058481f950f78aa24fe6698515c4389956bd717e0fb33354d6a8): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-b8b49 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3cb147dcc50c058481f950f78aa24fe6698515c4389956bd717e0fb33354d6a8" Netns:"/var/run/netns/10f1353f-22b6-4620-b3a7-e7f240c56b4f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-b8b49;K8S_POD_INFRA_CONTAINER_ID=3cb147dcc50c058481f950f78aa24fe6698515c4389956bd717e0fb33354d6a8;K8S_POD_UID=e377ec8b-a310-46e7-8474-fdf0982fbfcc" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49/e377ec8b-a310-46e7-8474-fdf0982fbfcc:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49 3cb147dcc50c058481f950f78aa24fe6698515c4389956bd717e0fb33354d6a8 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:1e [10.133.0.30/23]
Sep 15 09:23:00.812452 ip-10-0-136-31 kubenswrapper[2575]:         '
Sep 15 09:23:00.812452 ip-10-0-136-31 kubenswrapper[2575]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 15 09:23:00.812452 ip-10-0-136-31 kubenswrapper[2575]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"
Sep 15 09:23:00.832987 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.832956    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"
Sep 15 09:23:00.835367 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:23:00.835338    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-h6gdw\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="89fa51e1-d457-499b-81ae-e46d6887b59b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw"
Sep 15 09:23:00.837165 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:23:00.837142    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n76v9\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="dcebccd2-3723-4103-81e0-8bec562f3cbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"
Sep 15 09:23:00.841215 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.841194    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw"
Sep 15 09:23:00.843398 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:23:00.843359    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-h6gdw\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="89fa51e1-d457-499b-81ae-e46d6887b59b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw"
Sep 15 09:23:00.847623 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:23:00.847596    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-n76v9\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="dcebccd2-3723-4103-81e0-8bec562f3cbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"
Sep 15 09:23:00.889722 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.889679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z9hc\" (UniqueName: \"kubernetes.io/projected/38567e1e-1f7e-4819-9f8c-f1d4d6de10ef-kube-api-access-7z9hc\") pod \"limitador-operator-controller-manager-74495c69f8-v4k4g\" (UID: \"38567e1e-1f7e-4819-9f8c-f1d4d6de10ef\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v4k4g"
Sep 15 09:23:00.898006 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.897978    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z9hc\" (UniqueName: \"kubernetes.io/projected/38567e1e-1f7e-4819-9f8c-f1d4d6de10ef-kube-api-access-7z9hc\") pod \"limitador-operator-controller-manager-74495c69f8-v4k4g\" (UID: \"38567e1e-1f7e-4819-9f8c-f1d4d6de10ef\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v4k4g"
Sep 15 09:23:00.980635 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.980541    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"
Sep 15 09:23:00.986722 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.986697    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v4k4g"
Sep 15 09:23:00.990941 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.990915    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcebccd2-3723-4103-81e0-8bec562f3cbc-extensions-socket-volume\") pod \"dcebccd2-3723-4103-81e0-8bec562f3cbc\" (UID: \"dcebccd2-3723-4103-81e0-8bec562f3cbc\") "
Sep 15 09:23:00.991040 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.990987    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pmkf\" (UniqueName: \"kubernetes.io/projected/89fa51e1-d457-499b-81ae-e46d6887b59b-kube-api-access-6pmkf\") pod \"89fa51e1-d457-499b-81ae-e46d6887b59b\" (UID: \"89fa51e1-d457-499b-81ae-e46d6887b59b\") "
Sep 15 09:23:00.991118 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.991106    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqrkn\" (UniqueName: \"kubernetes.io/projected/dcebccd2-3723-4103-81e0-8bec562f3cbc-kube-api-access-jqrkn\") pod \"dcebccd2-3723-4103-81e0-8bec562f3cbc\" (UID: \"dcebccd2-3723-4103-81e0-8bec562f3cbc\") "
Sep 15 09:23:00.991317 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.991291    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcebccd2-3723-4103-81e0-8bec562f3cbc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dcebccd2-3723-4103-81e0-8bec562f3cbc" (UID: "dcebccd2-3723-4103-81e0-8bec562f3cbc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:23:00.991519 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.991491    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcebccd2-3723-4103-81e0-8bec562f3cbc-extensions-socket-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:23:00.993514 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.993479    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89fa51e1-d457-499b-81ae-e46d6887b59b-kube-api-access-6pmkf" (OuterVolumeSpecName: "kube-api-access-6pmkf") pod "89fa51e1-d457-499b-81ae-e46d6887b59b" (UID: "89fa51e1-d457-499b-81ae-e46d6887b59b"). InnerVolumeSpecName "kube-api-access-6pmkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:23:00.993783 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:00.993734    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcebccd2-3723-4103-81e0-8bec562f3cbc-kube-api-access-jqrkn" (OuterVolumeSpecName: "kube-api-access-jqrkn") pod "dcebccd2-3723-4103-81e0-8bec562f3cbc" (UID: "dcebccd2-3723-4103-81e0-8bec562f3cbc"). InnerVolumeSpecName "kube-api-access-jqrkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:23:01.092059 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.092022    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqrkn\" (UniqueName: \"kubernetes.io/projected/dcebccd2-3723-4103-81e0-8bec562f3cbc-kube-api-access-jqrkn\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:23:01.092059 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.092057    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pmkf\" (UniqueName: \"kubernetes.io/projected/89fa51e1-d457-499b-81ae-e46d6887b59b-kube-api-access-6pmkf\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:23:01.266526 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.266432    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"]
Sep 15 09:23:01.268129 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.268100    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-v4k4g"]
Sep 15 09:23:01.269381 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:23:01.269323    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5a6f4b_7dcf_4cea_b670_c8185975aa3e.slice/crio-18cde14d06b6d1cd86aab27f481793e482e66f7e1266bb2bab9f5ab1bef6736f WatchSource:0}: Error finding container 18cde14d06b6d1cd86aab27f481793e482e66f7e1266bb2bab9f5ab1bef6736f: Status 404 returned error can't find the container with id 18cde14d06b6d1cd86aab27f481793e482e66f7e1266bb2bab9f5ab1bef6736f
Sep 15 09:23:01.271614 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:23:01.271585    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38567e1e_1f7e_4819_9f8c_f1d4d6de10ef.slice/crio-bbcd9f03673b8708668d797a7b409d9a844bbeb791f95ae8f13aa6a01fef2a7d WatchSource:0}: Error finding container bbcd9f03673b8708668d797a7b409d9a844bbeb791f95ae8f13aa6a01fef2a7d: Status 404 returned error can't find the container with id bbcd9f03673b8708668d797a7b409d9a844bbeb791f95ae8f13aa6a01fef2a7d
Sep 15 09:23:01.414545 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.414510    2575 generic.go:356] "Generic (PLEG): container finished" podID="dcebccd2-3723-4103-81e0-8bec562f3cbc" containerID="b579e069448429e1b72622b7309ecfbf2092885893d8d71c00e3dfd6d4d9c220" exitCode=0
Sep 15 09:23:01.414745 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.414552    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n76v9"
Sep 15 09:23:01.414745 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.414606    2575 scope.go:117] "RemoveContainer" containerID="b579e069448429e1b72622b7309ecfbf2092885893d8d71c00e3dfd6d4d9c220"
Sep 15 09:23:01.416155 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.416134    2575 generic.go:356] "Generic (PLEG): container finished" podID="89fa51e1-d457-499b-81ae-e46d6887b59b" containerID="c3dd7cdd8cb9de2fe7f3e5612ea4c0dd7333845322d21ed0b33335e68317f3f8" exitCode=0
Sep 15 09:23:01.416234 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.416189    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h6gdw"
Sep 15 09:23:01.418073 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.418044    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v4k4g" event={"ID":"38567e1e-1f7e-4819-9f8c-f1d4d6de10ef","Type":"ContainerStarted","Data":"1fc6c3569784eea3b529b3df100efcdfcb3cf9d57d0264669669f92265481d3a"}
Sep 15 09:23:01.418216 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.418115    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v4k4g" event={"ID":"38567e1e-1f7e-4819-9f8c-f1d4d6de10ef","Type":"ContainerStarted","Data":"bbcd9f03673b8708668d797a7b409d9a844bbeb791f95ae8f13aa6a01fef2a7d"}
Sep 15 09:23:01.418216 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.418160    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v4k4g"
Sep 15 09:23:01.420120 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.420092    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"
Sep 15 09:23:01.420248 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.420089    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb" event={"ID":"6f5a6f4b-7dcf-4cea-b670-c8185975aa3e","Type":"ContainerStarted","Data":"8844ca239bc8bf704b4ae556516cb496667225754d55a432218f45765af9421f"}
Sep 15 09:23:01.420248 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.420234    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"
Sep 15 09:23:01.420373 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.420263    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb" event={"ID":"6f5a6f4b-7dcf-4cea-b670-c8185975aa3e","Type":"ContainerStarted","Data":"18cde14d06b6d1cd86aab27f481793e482e66f7e1266bb2bab9f5ab1bef6736f"}
Sep 15 09:23:01.425056 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.425037    2575 scope.go:117] "RemoveContainer" containerID="b579e069448429e1b72622b7309ecfbf2092885893d8d71c00e3dfd6d4d9c220"
Sep 15 09:23:01.425427 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:23:01.425408    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b579e069448429e1b72622b7309ecfbf2092885893d8d71c00e3dfd6d4d9c220\": container with ID starting with b579e069448429e1b72622b7309ecfbf2092885893d8d71c00e3dfd6d4d9c220 not found: ID does not exist" containerID="b579e069448429e1b72622b7309ecfbf2092885893d8d71c00e3dfd6d4d9c220"
Sep 15 09:23:01.425489 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.425438    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b579e069448429e1b72622b7309ecfbf2092885893d8d71c00e3dfd6d4d9c220"} err="failed to get container status \"b579e069448429e1b72622b7309ecfbf2092885893d8d71c00e3dfd6d4d9c220\": rpc error: code = NotFound desc = could not find container \"b579e069448429e1b72622b7309ecfbf2092885893d8d71c00e3dfd6d4d9c220\": container with ID starting with b579e069448429e1b72622b7309ecfbf2092885893d8d71c00e3dfd6d4d9c220 not found: ID does not exist"
Sep 15 09:23:01.425489 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.425456    2575 scope.go:117] "RemoveContainer" containerID="c3dd7cdd8cb9de2fe7f3e5612ea4c0dd7333845322d21ed0b33335e68317f3f8"
Sep 15 09:23:01.430131 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.430108    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"
Sep 15 09:23:01.434349 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.434332    2575 scope.go:117] "RemoveContainer" containerID="c3dd7cdd8cb9de2fe7f3e5612ea4c0dd7333845322d21ed0b33335e68317f3f8"
Sep 15 09:23:01.434704 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:23:01.434687    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3dd7cdd8cb9de2fe7f3e5612ea4c0dd7333845322d21ed0b33335e68317f3f8\": container with ID starting with c3dd7cdd8cb9de2fe7f3e5612ea4c0dd7333845322d21ed0b33335e68317f3f8 not found: ID does not exist" containerID="c3dd7cdd8cb9de2fe7f3e5612ea4c0dd7333845322d21ed0b33335e68317f3f8"
Sep 15 09:23:01.434749 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.434711    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3dd7cdd8cb9de2fe7f3e5612ea4c0dd7333845322d21ed0b33335e68317f3f8"} err="failed to get container status \"c3dd7cdd8cb9de2fe7f3e5612ea4c0dd7333845322d21ed0b33335e68317f3f8\": rpc error: code = NotFound desc = could not find container \"c3dd7cdd8cb9de2fe7f3e5612ea4c0dd7333845322d21ed0b33335e68317f3f8\": container with ID starting with c3dd7cdd8cb9de2fe7f3e5612ea4c0dd7333845322d21ed0b33335e68317f3f8 not found: ID does not exist"
Sep 15 09:23:01.442468 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.442413    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v4k4g" podStartSLOduration=1.442391222 podStartE2EDuration="1.442391222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:23:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:23:01.440653853 +0000 UTC m=+545.090069973" watchObservedRunningTime="2026-09-15 09:23:01.442391222 +0000 UTC m=+545.091807315"
Sep 15 09:23:01.463566 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:23:01.463523    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-b8b49\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="e377ec8b-a310-46e7-8474-fdf0982fbfcc" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"
Sep 15 09:23:01.463566 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.463516    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb" podStartSLOduration=1.463499677 podStartE2EDuration="1.463499677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:23:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:23:01.461580378 +0000 UTC m=+545.110996471" watchObservedRunningTime="2026-09-15 09:23:01.463499677 +0000 UTC m=+545.112915769"
Sep 15 09:23:01.534486 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.534394    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:01.597097 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.597059    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cnrl\" (UniqueName: \"kubernetes.io/projected/e377ec8b-a310-46e7-8474-fdf0982fbfcc-kube-api-access-5cnrl\") pod \"e377ec8b-a310-46e7-8474-fdf0982fbfcc\" (UID: \"e377ec8b-a310-46e7-8474-fdf0982fbfcc\") "
Sep 15 09:23:01.597307 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.597118    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e377ec8b-a310-46e7-8474-fdf0982fbfcc-extensions-socket-volume\") pod \"e377ec8b-a310-46e7-8474-fdf0982fbfcc\" (UID: \"e377ec8b-a310-46e7-8474-fdf0982fbfcc\") "
Sep 15 09:23:01.597414 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.597390    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e377ec8b-a310-46e7-8474-fdf0982fbfcc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e377ec8b-a310-46e7-8474-fdf0982fbfcc" (UID: "e377ec8b-a310-46e7-8474-fdf0982fbfcc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:23:01.599522 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.599496    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e377ec8b-a310-46e7-8474-fdf0982fbfcc-kube-api-access-5cnrl" (OuterVolumeSpecName: "kube-api-access-5cnrl") pod "e377ec8b-a310-46e7-8474-fdf0982fbfcc" (UID: "e377ec8b-a310-46e7-8474-fdf0982fbfcc"). InnerVolumeSpecName "kube-api-access-5cnrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:23:01.632553 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.632519    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:01.697823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.697749    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cnrl\" (UniqueName: \"kubernetes.io/projected/e377ec8b-a310-46e7-8474-fdf0982fbfcc-kube-api-access-5cnrl\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:23:01.697823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:01.697801    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e377ec8b-a310-46e7-8474-fdf0982fbfcc-extensions-socket-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:23:02.427516 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:02.427481    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"
Sep 15 09:23:02.433968 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:23:02.430259    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-b8b49\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="e377ec8b-a310-46e7-8474-fdf0982fbfcc" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"
Sep 15 09:23:02.438090 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:23:02.438055    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-b8b49\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="e377ec8b-a310-46e7-8474-fdf0982fbfcc" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b8b49"
Sep 15 09:23:02.858892 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:02.858791    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89fa51e1-d457-499b-81ae-e46d6887b59b" path="/var/lib/kubelet/pods/89fa51e1-d457-499b-81ae-e46d6887b59b/volumes"
Sep 15 09:23:02.859237 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:02.859217    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcebccd2-3723-4103-81e0-8bec562f3cbc" path="/var/lib/kubelet/pods/dcebccd2-3723-4103-81e0-8bec562f3cbc/volumes"
Sep 15 09:23:02.859576 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:02.859560    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e377ec8b-a310-46e7-8474-fdf0982fbfcc" path="/var/lib/kubelet/pods/e377ec8b-a310-46e7-8474-fdf0982fbfcc/volumes"
Sep 15 09:23:03.376158 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:03.376129    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-vdj8k"
Sep 15 09:23:04.624001 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:04.623964    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:04.720811 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:04.720783    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:06.521222 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:06.521186    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:06.577318 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:06.577285    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:06.946471 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:06.946438    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:07.000996 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:07.000964    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:12.430161 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:12.430131    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"
Sep 15 09:23:12.430661 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:12.430367    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-v4k4g"
Sep 15 09:23:13.917876 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:13.917841    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:14.018263 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:14.018218    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:14.316989 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:14.316901    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:14.415505 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:14.415471    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:14.516263 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:14.516226    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:14.571533 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:14.571444    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:16.094599 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.094568    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"]
Sep 15 09:23:16.094999 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.094790    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb" podUID="6f5a6f4b-7dcf-4cea-b670-c8185975aa3e" containerName="manager" containerID="cri-o://8844ca239bc8bf704b4ae556516cb496667225754d55a432218f45765af9421f" gracePeriod=10
Sep 15 09:23:16.323954 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.323852    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"]
Sep 15 09:23:16.326719 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.326698    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"
Sep 15 09:23:16.337705 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.337680    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"
Sep 15 09:23:16.342497 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.342474    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"]
Sep 15 09:23:16.494249 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.494217    2575 generic.go:356] "Generic (PLEG): container finished" podID="6f5a6f4b-7dcf-4cea-b670-c8185975aa3e" containerID="8844ca239bc8bf704b4ae556516cb496667225754d55a432218f45765af9421f" exitCode=0
Sep 15 09:23:16.494411 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.494264    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"
Sep 15 09:23:16.494411 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.494309    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb" event={"ID":"6f5a6f4b-7dcf-4cea-b670-c8185975aa3e","Type":"ContainerDied","Data":"8844ca239bc8bf704b4ae556516cb496667225754d55a432218f45765af9421f"}
Sep 15 09:23:16.494411 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.494354    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb" event={"ID":"6f5a6f4b-7dcf-4cea-b670-c8185975aa3e","Type":"ContainerDied","Data":"18cde14d06b6d1cd86aab27f481793e482e66f7e1266bb2bab9f5ab1bef6736f"}
Sep 15 09:23:16.494411 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.494378    2575 scope.go:117] "RemoveContainer" containerID="8844ca239bc8bf704b4ae556516cb496667225754d55a432218f45765af9421f"
Sep 15 09:23:16.506255 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.506236    2575 scope.go:117] "RemoveContainer" containerID="8844ca239bc8bf704b4ae556516cb496667225754d55a432218f45765af9421f"
Sep 15 09:23:16.506595 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:23:16.506572    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8844ca239bc8bf704b4ae556516cb496667225754d55a432218f45765af9421f\": container with ID starting with 8844ca239bc8bf704b4ae556516cb496667225754d55a432218f45765af9421f not found: ID does not exist" containerID="8844ca239bc8bf704b4ae556516cb496667225754d55a432218f45765af9421f"
Sep 15 09:23:16.506655 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.506608    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8844ca239bc8bf704b4ae556516cb496667225754d55a432218f45765af9421f"} err="failed to get container status \"8844ca239bc8bf704b4ae556516cb496667225754d55a432218f45765af9421f\": rpc error: code = NotFound desc = could not find container \"8844ca239bc8bf704b4ae556516cb496667225754d55a432218f45765af9421f\": container with ID starting with 8844ca239bc8bf704b4ae556516cb496667225754d55a432218f45765af9421f not found: ID does not exist"
Sep 15 09:23:16.519960 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.519932    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f5a6f4b-7dcf-4cea-b670-c8185975aa3e-extensions-socket-volume\") pod \"6f5a6f4b-7dcf-4cea-b670-c8185975aa3e\" (UID: \"6f5a6f4b-7dcf-4cea-b670-c8185975aa3e\") "
Sep 15 09:23:16.520092 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.520049    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbbd7\" (UniqueName: \"kubernetes.io/projected/6f5a6f4b-7dcf-4cea-b670-c8185975aa3e-kube-api-access-rbbd7\") pod \"6f5a6f4b-7dcf-4cea-b670-c8185975aa3e\" (UID: \"6f5a6f4b-7dcf-4cea-b670-c8185975aa3e\") "
Sep 15 09:23:16.520188 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.520167    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg4dz\" (UniqueName: \"kubernetes.io/projected/63912ac3-b78a-455c-b0bc-5a6f22b47ba4-kube-api-access-kg4dz\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d6x2r\" (UID: \"63912ac3-b78a-455c-b0bc-5a6f22b47ba4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"
Sep 15 09:23:16.520288 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.520272    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63912ac3-b78a-455c-b0bc-5a6f22b47ba4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d6x2r\" (UID: \"63912ac3-b78a-455c-b0bc-5a6f22b47ba4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"
Sep 15 09:23:16.520335 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.520317    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f5a6f4b-7dcf-4cea-b670-c8185975aa3e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6f5a6f4b-7dcf-4cea-b670-c8185975aa3e" (UID: "6f5a6f4b-7dcf-4cea-b670-c8185975aa3e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:23:16.520390 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.520379    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f5a6f4b-7dcf-4cea-b670-c8185975aa3e-extensions-socket-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:23:16.522274 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.522252    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f5a6f4b-7dcf-4cea-b670-c8185975aa3e-kube-api-access-rbbd7" (OuterVolumeSpecName: "kube-api-access-rbbd7") pod "6f5a6f4b-7dcf-4cea-b670-c8185975aa3e" (UID: "6f5a6f4b-7dcf-4cea-b670-c8185975aa3e"). InnerVolumeSpecName "kube-api-access-rbbd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:23:16.620884 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.620844    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg4dz\" (UniqueName: \"kubernetes.io/projected/63912ac3-b78a-455c-b0bc-5a6f22b47ba4-kube-api-access-kg4dz\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d6x2r\" (UID: \"63912ac3-b78a-455c-b0bc-5a6f22b47ba4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"
Sep 15 09:23:16.621067 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.620909    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63912ac3-b78a-455c-b0bc-5a6f22b47ba4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d6x2r\" (UID: \"63912ac3-b78a-455c-b0bc-5a6f22b47ba4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"
Sep 15 09:23:16.621067 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.620965    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbbd7\" (UniqueName: \"kubernetes.io/projected/6f5a6f4b-7dcf-4cea-b670-c8185975aa3e-kube-api-access-rbbd7\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:23:16.621285 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.621264    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63912ac3-b78a-455c-b0bc-5a6f22b47ba4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d6x2r\" (UID: \"63912ac3-b78a-455c-b0bc-5a6f22b47ba4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"
Sep 15 09:23:16.629451 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.629421    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg4dz\" (UniqueName: \"kubernetes.io/projected/63912ac3-b78a-455c-b0bc-5a6f22b47ba4-kube-api-access-kg4dz\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d6x2r\" (UID: \"63912ac3-b78a-455c-b0bc-5a6f22b47ba4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"
Sep 15 09:23:16.645189 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.645157    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"
Sep 15 09:23:16.822986 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.822952    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"]
Sep 15 09:23:16.827112 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.827086    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8m7vb"]
Sep 15 09:23:16.859830 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.859799    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f5a6f4b-7dcf-4cea-b670-c8185975aa3e" path="/var/lib/kubelet/pods/6f5a6f4b-7dcf-4cea-b670-c8185975aa3e/volumes"
Sep 15 09:23:16.917603 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:16.917579    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"]
Sep 15 09:23:16.919485 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:23:16.919458    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63912ac3_b78a_455c_b0bc_5a6f22b47ba4.slice/crio-81741e4c937b9c860d27541bb2694a6dfef52ed0a6c9bb51f28e72515dc1754b WatchSource:0}: Error finding container 81741e4c937b9c860d27541bb2694a6dfef52ed0a6c9bb51f28e72515dc1754b: Status 404 returned error can't find the container with id 81741e4c937b9c860d27541bb2694a6dfef52ed0a6c9bb51f28e72515dc1754b
Sep 15 09:23:17.501206 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:17.501168    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r" event={"ID":"63912ac3-b78a-455c-b0bc-5a6f22b47ba4","Type":"ContainerStarted","Data":"f9ee47cce25573d5b3ddd608bc326ece82d273456b87f653f56fce46085e579b"}
Sep 15 09:23:17.501669 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:17.501226    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r" event={"ID":"63912ac3-b78a-455c-b0bc-5a6f22b47ba4","Type":"ContainerStarted","Data":"81741e4c937b9c860d27541bb2694a6dfef52ed0a6c9bb51f28e72515dc1754b"}
Sep 15 09:23:17.501669 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:17.501371    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"
Sep 15 09:23:17.521029 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:17.520970    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r" podStartSLOduration=1.5209504740000002 podStartE2EDuration="1.520950474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:23:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:23:17.519861288 +0000 UTC m=+561.169277387" watchObservedRunningTime="2026-09-15 09:23:17.520950474 +0000 UTC m=+561.170366568"
Sep 15 09:23:23.322473 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:23.322413    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:23.423258 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:23.423224    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:26.329150 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:26.329114    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:26.437007 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:26.436977    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:28.509308 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:28.509278    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"
Sep 15 09:23:28.773777 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:28.773676    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:28.875181 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:28.875155    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:32.578958 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:32.578924    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:32.880001 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:32.879917    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:45.881431 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:45.881395    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jlzvq"]
Sep 15 09:23:45.881958 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:45.881929    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f5a6f4b-7dcf-4cea-b670-c8185975aa3e" containerName="manager"
Sep 15 09:23:45.881958 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:45.881949    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f5a6f4b-7dcf-4cea-b670-c8185975aa3e" containerName="manager"
Sep 15 09:23:45.882073 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:45.882052    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f5a6f4b-7dcf-4cea-b670-c8185975aa3e" containerName="manager"
Sep 15 09:23:45.884405 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:45.884385    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-jlzvq"
Sep 15 09:23:45.886751 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:45.886730    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wl9lf\""
Sep 15 09:23:45.886848 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:45.886730    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 15 09:23:45.891110 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:45.891089    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jlzvq"]
Sep 15 09:23:45.895885 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:45.895861    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:45.956380 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:45.956350    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvlts\" (UniqueName: \"kubernetes.io/projected/8646d608-47c2-4a37-9cf2-c08a5a31cec5-kube-api-access-fvlts\") pod \"limitador-limitador-8588749977-jlzvq\" (UID: \"8646d608-47c2-4a37-9cf2-c08a5a31cec5\") " pod="kuadrant-system/limitador-limitador-8588749977-jlzvq"
Sep 15 09:23:45.956811 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:45.956786    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8646d608-47c2-4a37-9cf2-c08a5a31cec5-config-file\") pod \"limitador-limitador-8588749977-jlzvq\" (UID: \"8646d608-47c2-4a37-9cf2-c08a5a31cec5\") " pod="kuadrant-system/limitador-limitador-8588749977-jlzvq"
Sep 15 09:23:45.981140 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:45.981106    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:45.989576 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:45.989549    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jlzvq"]
Sep 15 09:23:46.058123 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:46.058093    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8646d608-47c2-4a37-9cf2-c08a5a31cec5-config-file\") pod \"limitador-limitador-8588749977-jlzvq\" (UID: \"8646d608-47c2-4a37-9cf2-c08a5a31cec5\") " pod="kuadrant-system/limitador-limitador-8588749977-jlzvq"
Sep 15 09:23:46.058320 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:46.058156    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvlts\" (UniqueName: \"kubernetes.io/projected/8646d608-47c2-4a37-9cf2-c08a5a31cec5-kube-api-access-fvlts\") pod \"limitador-limitador-8588749977-jlzvq\" (UID: \"8646d608-47c2-4a37-9cf2-c08a5a31cec5\") " pod="kuadrant-system/limitador-limitador-8588749977-jlzvq"
Sep 15 09:23:46.058831 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:46.058807    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8646d608-47c2-4a37-9cf2-c08a5a31cec5-config-file\") pod \"limitador-limitador-8588749977-jlzvq\" (UID: \"8646d608-47c2-4a37-9cf2-c08a5a31cec5\") " pod="kuadrant-system/limitador-limitador-8588749977-jlzvq"
Sep 15 09:23:46.065522 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:46.065501    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvlts\" (UniqueName: \"kubernetes.io/projected/8646d608-47c2-4a37-9cf2-c08a5a31cec5-kube-api-access-fvlts\") pod \"limitador-limitador-8588749977-jlzvq\" (UID: \"8646d608-47c2-4a37-9cf2-c08a5a31cec5\") " pod="kuadrant-system/limitador-limitador-8588749977-jlzvq"
Sep 15 09:23:46.086171 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:46.086131    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:46.195363 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:46.195321    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-jlzvq"
Sep 15 09:23:46.466344 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:46.466266    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jlzvq"]
Sep 15 09:23:46.469424 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:23:46.469394    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8646d608_47c2_4a37_9cf2_c08a5a31cec5.slice/crio-d48c700ef1a3d4ba6e52a3b6822613cfc695508ef7a83ba468cca66754edba72 WatchSource:0}: Error finding container d48c700ef1a3d4ba6e52a3b6822613cfc695508ef7a83ba468cca66754edba72: Status 404 returned error can't find the container with id d48c700ef1a3d4ba6e52a3b6822613cfc695508ef7a83ba468cca66754edba72
Sep 15 09:23:46.645879 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:46.645844    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-jlzvq" event={"ID":"8646d608-47c2-4a37-9cf2-c08a5a31cec5","Type":"ContainerStarted","Data":"d48c700ef1a3d4ba6e52a3b6822613cfc695508ef7a83ba468cca66754edba72"}
Sep 15 09:23:46.717491 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:46.717399    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:46.800836 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:46.800798    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:23:46.804187 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:46.804157    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-5gbvr"]
Sep 15 09:23:46.806978 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:46.806958    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-5gbvr"
Sep 15 09:23:46.809196 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:46.809176    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qf6s4\""
Sep 15 09:23:46.815940 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:46.815918    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-5gbvr"]
Sep 15 09:23:46.865102 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:46.865071    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnrp7\" (UniqueName: \"kubernetes.io/projected/d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc-kube-api-access-wnrp7\") pod \"authorino-59c974bd48-5gbvr\" (UID: \"d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc\") " pod="kuadrant-system/authorino-59c974bd48-5gbvr"
Sep 15 09:23:46.965485 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:46.965452    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnrp7\" (UniqueName: \"kubernetes.io/projected/d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc-kube-api-access-wnrp7\") pod \"authorino-59c974bd48-5gbvr\" (UID: \"d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc\") " pod="kuadrant-system/authorino-59c974bd48-5gbvr"
Sep 15 09:23:46.973046 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:46.972999    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnrp7\" (UniqueName: \"kubernetes.io/projected/d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc-kube-api-access-wnrp7\") pod \"authorino-59c974bd48-5gbvr\" (UID: \"d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc\") " pod="kuadrant-system/authorino-59c974bd48-5gbvr"
Sep 15 09:23:47.116547 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:47.116510    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-5gbvr"
Sep 15 09:23:47.384361 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:47.384333    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-5gbvr"]
Sep 15 09:23:47.550859 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:23:47.550827    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2a3b11c_816e_42a1_9d0f_3f9bc19a35fc.slice/crio-2dc4ebaa3d49b8b4ba387ba231382c51eadcb989c531611b1d56dae6c7a352bb WatchSource:0}: Error finding container 2dc4ebaa3d49b8b4ba387ba231382c51eadcb989c531611b1d56dae6c7a352bb: Status 404 returned error can't find the container with id 2dc4ebaa3d49b8b4ba387ba231382c51eadcb989c531611b1d56dae6c7a352bb
Sep 15 09:23:47.651825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:47.651796    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-5gbvr" event={"ID":"d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc","Type":"ContainerStarted","Data":"2dc4ebaa3d49b8b4ba387ba231382c51eadcb989c531611b1d56dae6c7a352bb"}
Sep 15 09:23:47.653435 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:47.653410    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-jlzvq" event={"ID":"8646d608-47c2-4a37-9cf2-c08a5a31cec5","Type":"ContainerStarted","Data":"d1f1967a56677de72ad778c809706fd96f5b172045bdda62d35a2e374d061fd4"}
Sep 15 09:23:47.653556 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:47.653536    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-jlzvq"
Sep 15 09:23:49.670697 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:49.670658    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-5gbvr" event={"ID":"d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc","Type":"ContainerStarted","Data":"a30d5836a99c88d7a7e4c40152f9c4a6bcf91589701e408da922b67dd91796aa"}
Sep 15 09:23:49.685333 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:49.685284    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-5gbvr" podStartSLOduration=2.300032076 podStartE2EDuration="3.685268659s" totalImagesPullingTime="1.385236583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:23:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:23:49.684030779 +0000 UTC m=+593.333446872" watchObservedRunningTime="2026-09-15 09:23:49.685268659 +0000 UTC m=+593.334684749"
Sep 15 09:23:49.685650 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:49.685629    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-jlzvq" podStartSLOduration=3.57333706 podStartE2EDuration="4.685623649s" totalImagesPullingTime="1.112286589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:23:47.667814122 +0000 UTC m=+591.317230215" watchObservedRunningTime="2026-09-15 09:23:49.685623649 +0000 UTC m=+593.335039742"
Sep 15 09:23:56.790818 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:56.790785    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:23:56.796584 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:56.796561    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:23:56.797046 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:56.797026    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:23:56.803015 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:56.802999    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:23:58.660205 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:58.660174    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-jlzvq"
Sep 15 09:23:59.284285 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:59.284253    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jlzvq"]
Sep 15 09:23:59.284471 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:59.284448    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-jlzvq" podUID="8646d608-47c2-4a37-9cf2-c08a5a31cec5" containerName="limitador" containerID="cri-o://d1f1967a56677de72ad778c809706fd96f5b172045bdda62d35a2e374d061fd4" gracePeriod=30
Sep 15 09:23:59.732938 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:59.732906    2575 generic.go:356] "Generic (PLEG): container finished" podID="8646d608-47c2-4a37-9cf2-c08a5a31cec5" containerID="d1f1967a56677de72ad778c809706fd96f5b172045bdda62d35a2e374d061fd4" exitCode=0
Sep 15 09:23:59.733283 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:59.732975    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-jlzvq" event={"ID":"8646d608-47c2-4a37-9cf2-c08a5a31cec5","Type":"ContainerDied","Data":"d1f1967a56677de72ad778c809706fd96f5b172045bdda62d35a2e374d061fd4"}
Sep 15 09:23:59.832050 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:59.832023    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-jlzvq"
Sep 15 09:23:59.980533 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:59.980502    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8646d608-47c2-4a37-9cf2-c08a5a31cec5-config-file\") pod \"8646d608-47c2-4a37-9cf2-c08a5a31cec5\" (UID: \"8646d608-47c2-4a37-9cf2-c08a5a31cec5\") "
Sep 15 09:23:59.980734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:59.980568    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvlts\" (UniqueName: \"kubernetes.io/projected/8646d608-47c2-4a37-9cf2-c08a5a31cec5-kube-api-access-fvlts\") pod \"8646d608-47c2-4a37-9cf2-c08a5a31cec5\" (UID: \"8646d608-47c2-4a37-9cf2-c08a5a31cec5\") "
Sep 15 09:23:59.980948 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:59.980921    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8646d608-47c2-4a37-9cf2-c08a5a31cec5-config-file" (OuterVolumeSpecName: "config-file") pod "8646d608-47c2-4a37-9cf2-c08a5a31cec5" (UID: "8646d608-47c2-4a37-9cf2-c08a5a31cec5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:23:59.982851 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:23:59.982824    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8646d608-47c2-4a37-9cf2-c08a5a31cec5-kube-api-access-fvlts" (OuterVolumeSpecName: "kube-api-access-fvlts") pod "8646d608-47c2-4a37-9cf2-c08a5a31cec5" (UID: "8646d608-47c2-4a37-9cf2-c08a5a31cec5"). InnerVolumeSpecName "kube-api-access-fvlts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:24:00.081885 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:00.081857    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvlts\" (UniqueName: \"kubernetes.io/projected/8646d608-47c2-4a37-9cf2-c08a5a31cec5-kube-api-access-fvlts\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:24:00.081885 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:00.081883    2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8646d608-47c2-4a37-9cf2-c08a5a31cec5-config-file\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:24:00.738720 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:00.738689    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-jlzvq"
Sep 15 09:24:00.738720 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:00.738699    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-jlzvq" event={"ID":"8646d608-47c2-4a37-9cf2-c08a5a31cec5","Type":"ContainerDied","Data":"d48c700ef1a3d4ba6e52a3b6822613cfc695508ef7a83ba468cca66754edba72"}
Sep 15 09:24:00.739211 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:00.738779    2575 scope.go:117] "RemoveContainer" containerID="d1f1967a56677de72ad778c809706fd96f5b172045bdda62d35a2e374d061fd4"
Sep 15 09:24:00.759821 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:00.759797    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jlzvq"]
Sep 15 09:24:00.762735 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:00.762711    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jlzvq"]
Sep 15 09:24:00.858776 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:00.858730    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8646d608-47c2-4a37-9cf2-c08a5a31cec5" path="/var/lib/kubelet/pods/8646d608-47c2-4a37-9cf2-c08a5a31cec5/volumes"
Sep 15 09:24:01.276423 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.276388    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:01.374368 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.374341    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:01.770237 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.770204    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-v5ldt"]
Sep 15 09:24:01.770735 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.770716    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8646d608-47c2-4a37-9cf2-c08a5a31cec5" containerName="limitador"
Sep 15 09:24:01.770818 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.770741    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8646d608-47c2-4a37-9cf2-c08a5a31cec5" containerName="limitador"
Sep 15 09:24:01.770902 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.770847    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8646d608-47c2-4a37-9cf2-c08a5a31cec5" containerName="limitador"
Sep 15 09:24:01.774097 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.774077    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-v5ldt"
Sep 15 09:24:01.776551 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.776524    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 15 09:24:01.776551 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.776540    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:24:01.776551 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.776547    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 09:24:01.777590 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.777571    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-jmpsp\""
Sep 15 09:24:01.779998 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.779975    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-v5ldt"]
Sep 15 09:24:01.797689 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.797668    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:01.897739 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.897705    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e7b72d0e-2a08-42ac-9bd7-411d9c517311-data\") pod \"postgres-69fb4594cf-v5ldt\" (UID: \"e7b72d0e-2a08-42ac-9bd7-411d9c517311\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-v5ldt"
Sep 15 09:24:01.897907 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.897757    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g98m2\" (UniqueName: \"kubernetes.io/projected/e7b72d0e-2a08-42ac-9bd7-411d9c517311-kube-api-access-g98m2\") pod \"postgres-69fb4594cf-v5ldt\" (UID: \"e7b72d0e-2a08-42ac-9bd7-411d9c517311\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-v5ldt"
Sep 15 09:24:01.999232 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.999202    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g98m2\" (UniqueName: \"kubernetes.io/projected/e7b72d0e-2a08-42ac-9bd7-411d9c517311-kube-api-access-g98m2\") pod \"postgres-69fb4594cf-v5ldt\" (UID: \"e7b72d0e-2a08-42ac-9bd7-411d9c517311\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-v5ldt"
Sep 15 09:24:01.999394 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.999274    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e7b72d0e-2a08-42ac-9bd7-411d9c517311-data\") pod \"postgres-69fb4594cf-v5ldt\" (UID: \"e7b72d0e-2a08-42ac-9bd7-411d9c517311\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-v5ldt"
Sep 15 09:24:01.999656 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:01.999638    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e7b72d0e-2a08-42ac-9bd7-411d9c517311-data\") pod \"postgres-69fb4594cf-v5ldt\" (UID: \"e7b72d0e-2a08-42ac-9bd7-411d9c517311\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-v5ldt"
Sep 15 09:24:02.015633 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:02.015600    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g98m2\" (UniqueName: \"kubernetes.io/projected/e7b72d0e-2a08-42ac-9bd7-411d9c517311-kube-api-access-g98m2\") pod \"postgres-69fb4594cf-v5ldt\" (UID: \"e7b72d0e-2a08-42ac-9bd7-411d9c517311\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-v5ldt"
Sep 15 09:24:02.085578 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:02.085513    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-v5ldt"
Sep 15 09:24:02.355138 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:02.355113    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-v5ldt"]
Sep 15 09:24:02.357102 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:24:02.357066    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b72d0e_2a08_42ac_9bd7_411d9c517311.slice/crio-52899087339ab4d6287130a314361dff144d04cdb1b662e036bed303369ac20f WatchSource:0}: Error finding container 52899087339ab4d6287130a314361dff144d04cdb1b662e036bed303369ac20f: Status 404 returned error can't find the container with id 52899087339ab4d6287130a314361dff144d04cdb1b662e036bed303369ac20f
Sep 15 09:24:02.750219 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:02.750183    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-v5ldt" event={"ID":"e7b72d0e-2a08-42ac-9bd7-411d9c517311","Type":"ContainerStarted","Data":"52899087339ab4d6287130a314361dff144d04cdb1b662e036bed303369ac20f"}
Sep 15 09:24:07.778004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:07.777964    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-v5ldt" event={"ID":"e7b72d0e-2a08-42ac-9bd7-411d9c517311","Type":"ContainerStarted","Data":"000cc73fc953537c2f8ee7bf19379028ab296e3b11c2228009d2827b89f6792f"}
Sep 15 09:24:07.778493 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:07.778162    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-v5ldt"
Sep 15 09:24:07.793478 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:07.793436    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-v5ldt" podStartSLOduration=2.188278893 podStartE2EDuration="6.793421435s" totalImagesPullingTime="4.605142542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:24:07.791532211 +0000 UTC m=+611.440948303" watchObservedRunningTime="2026-09-15 09:24:07.793421435 +0000 UTC m=+611.442837528"
Sep 15 09:24:13.811396 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:13.811368    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-v5ldt"
Sep 15 09:24:14.156073 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:14.156043    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:14.272261 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:14.272183    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:14.641479 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:14.641450    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-686d496fd9-qvvzf"]
Sep 15 09:24:14.645023 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:14.645006    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-686d496fd9-qvvzf"
Sep 15 09:24:14.647058 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:14.647040    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 15 09:24:14.650714 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:14.650693    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-686d496fd9-qvvzf"]
Sep 15 09:24:14.813127 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:14.813099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xdrg\" (UniqueName: \"kubernetes.io/projected/76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5-kube-api-access-2xdrg\") pod \"authorino-686d496fd9-qvvzf\" (UID: \"76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5\") " pod="kuadrant-system/authorino-686d496fd9-qvvzf"
Sep 15 09:24:14.813127 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:14.813130    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5-tls-cert\") pod \"authorino-686d496fd9-qvvzf\" (UID: \"76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5\") " pod="kuadrant-system/authorino-686d496fd9-qvvzf"
Sep 15 09:24:14.914640 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:14.914557    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xdrg\" (UniqueName: \"kubernetes.io/projected/76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5-kube-api-access-2xdrg\") pod \"authorino-686d496fd9-qvvzf\" (UID: \"76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5\") " pod="kuadrant-system/authorino-686d496fd9-qvvzf"
Sep 15 09:24:14.914640 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:14.914589    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5-tls-cert\") pod \"authorino-686d496fd9-qvvzf\" (UID: \"76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5\") " pod="kuadrant-system/authorino-686d496fd9-qvvzf"
Sep 15 09:24:14.917179 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:14.917160    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5-tls-cert\") pod \"authorino-686d496fd9-qvvzf\" (UID: \"76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5\") " pod="kuadrant-system/authorino-686d496fd9-qvvzf"
Sep 15 09:24:14.921828 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:14.921810    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xdrg\" (UniqueName: \"kubernetes.io/projected/76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5-kube-api-access-2xdrg\") pod \"authorino-686d496fd9-qvvzf\" (UID: \"76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5\") " pod="kuadrant-system/authorino-686d496fd9-qvvzf"
Sep 15 09:24:14.955202 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:14.955174    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-686d496fd9-qvvzf"
Sep 15 09:24:15.220782 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:15.220738    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-686d496fd9-qvvzf"]
Sep 15 09:24:15.222906 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:24:15.222882    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76caafaf_fb3f_4dc1_bf1f_fdb81fe0d9d5.slice/crio-89125044997c2d40b1888e4b12bf11a39be84fb1fec9bf5d6154ad37f81540bb WatchSource:0}: Error finding container 89125044997c2d40b1888e4b12bf11a39be84fb1fec9bf5d6154ad37f81540bb: Status 404 returned error can't find the container with id 89125044997c2d40b1888e4b12bf11a39be84fb1fec9bf5d6154ad37f81540bb
Sep 15 09:24:15.815529 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:15.815502    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-686d496fd9-qvvzf" event={"ID":"76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5","Type":"ContainerStarted","Data":"c313671f6f077268324be11edc13daa1d063d9fec8163306b4b3efaafe15bb2d"}
Sep 15 09:24:15.815943 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:15.815550    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-686d496fd9-qvvzf" event={"ID":"76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5","Type":"ContainerStarted","Data":"89125044997c2d40b1888e4b12bf11a39be84fb1fec9bf5d6154ad37f81540bb"}
Sep 15 09:24:15.829043 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:15.828998    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-686d496fd9-qvvzf" podStartSLOduration=1.299148564 podStartE2EDuration="1.828980498s" totalImagesPullingTime="529.831934ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:24:15.828229611 +0000 UTC m=+619.477645704" watchObservedRunningTime="2026-09-15 09:24:15.828980498 +0000 UTC m=+619.478396595"
Sep 15 09:24:15.853568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:15.853539    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-5gbvr"]
Sep 15 09:24:15.853752 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:15.853728    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-5gbvr" podUID="d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc" containerName="authorino" containerID="cri-o://a30d5836a99c88d7a7e4c40152f9c4a6bcf91589701e408da922b67dd91796aa" gracePeriod=30
Sep 15 09:24:16.111530 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:16.111507    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-5gbvr"
Sep 15 09:24:16.224204 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:16.224154    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnrp7\" (UniqueName: \"kubernetes.io/projected/d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc-kube-api-access-wnrp7\") pod \"d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc\" (UID: \"d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc\") "
Sep 15 09:24:16.226405 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:16.226381    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc-kube-api-access-wnrp7" (OuterVolumeSpecName: "kube-api-access-wnrp7") pod "d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc" (UID: "d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc"). InnerVolumeSpecName "kube-api-access-wnrp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:24:16.325183 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:16.325106    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnrp7\" (UniqueName: \"kubernetes.io/projected/d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc-kube-api-access-wnrp7\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:24:16.821102 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:16.821070    2575 generic.go:356] "Generic (PLEG): container finished" podID="d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc" containerID="a30d5836a99c88d7a7e4c40152f9c4a6bcf91589701e408da922b67dd91796aa" exitCode=0
Sep 15 09:24:16.821493 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:16.821110    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-5gbvr"
Sep 15 09:24:16.821493 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:16.821155    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-5gbvr" event={"ID":"d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc","Type":"ContainerDied","Data":"a30d5836a99c88d7a7e4c40152f9c4a6bcf91589701e408da922b67dd91796aa"}
Sep 15 09:24:16.821493 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:16.821192    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-5gbvr" event={"ID":"d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc","Type":"ContainerDied","Data":"2dc4ebaa3d49b8b4ba387ba231382c51eadcb989c531611b1d56dae6c7a352bb"}
Sep 15 09:24:16.821493 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:16.821211    2575 scope.go:117] "RemoveContainer" containerID="a30d5836a99c88d7a7e4c40152f9c4a6bcf91589701e408da922b67dd91796aa"
Sep 15 09:24:16.829867 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:16.829848    2575 scope.go:117] "RemoveContainer" containerID="a30d5836a99c88d7a7e4c40152f9c4a6bcf91589701e408da922b67dd91796aa"
Sep 15 09:24:16.830157 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:24:16.830140    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a30d5836a99c88d7a7e4c40152f9c4a6bcf91589701e408da922b67dd91796aa\": container with ID starting with a30d5836a99c88d7a7e4c40152f9c4a6bcf91589701e408da922b67dd91796aa not found: ID does not exist" containerID="a30d5836a99c88d7a7e4c40152f9c4a6bcf91589701e408da922b67dd91796aa"
Sep 15 09:24:16.830203 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:16.830167    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a30d5836a99c88d7a7e4c40152f9c4a6bcf91589701e408da922b67dd91796aa"} err="failed to get container status \"a30d5836a99c88d7a7e4c40152f9c4a6bcf91589701e408da922b67dd91796aa\": rpc error: code = NotFound desc = could not find container \"a30d5836a99c88d7a7e4c40152f9c4a6bcf91589701e408da922b67dd91796aa\": container with ID starting with a30d5836a99c88d7a7e4c40152f9c4a6bcf91589701e408da922b67dd91796aa not found: ID does not exist"
Sep 15 09:24:16.839540 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:16.839521    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-5gbvr"]
Sep 15 09:24:16.843263 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:16.843243    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-5gbvr"]
Sep 15 09:24:16.858453 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:16.858431    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc" path="/var/lib/kubelet/pods/d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc/volumes"
Sep 15 09:24:20.730840 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:20.730787    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:20.830503 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:20.830470    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:20.881893 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:20.881862    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:20.947343 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:20.947313    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d5f7f7fc6-p62cl"]
Sep 15 09:24:20.947650 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:20.947639    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc" containerName="authorino"
Sep 15 09:24:20.947698 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:20.947654    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc" containerName="authorino"
Sep 15 09:24:20.947751 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:20.947741    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2a3b11c-816e-42a1-9d0f-3f9bc19a35fc" containerName="authorino"
Sep 15 09:24:20.949578 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:20.949565    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d5f7f7fc6-p62cl"
Sep 15 09:24:20.952024 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:20.951989    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 09:24:20.952161 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:20.952140    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 09:24:20.952998 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:20.952979    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 09:24:20.953117 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:20.953007    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lqk66\""
Sep 15 09:24:20.960759 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:20.960728    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d5f7f7fc6-p62cl"]
Sep 15 09:24:20.964442 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:20.964421    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69302caa-5f16-492a-8fbc-b0edbccb488f-metrics-certs\") pod \"maas-controller-d5f7f7fc6-p62cl\" (UID: \"69302caa-5f16-492a-8fbc-b0edbccb488f\") " pod="opendatahub/maas-controller-d5f7f7fc6-p62cl"
Sep 15 09:24:20.964542 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:20.964485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69302caa-5f16-492a-8fbc-b0edbccb488f-webhook-cert\") pod \"maas-controller-d5f7f7fc6-p62cl\" (UID: \"69302caa-5f16-492a-8fbc-b0edbccb488f\") " pod="opendatahub/maas-controller-d5f7f7fc6-p62cl"
Sep 15 09:24:20.964600 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:20.964539    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdtrz\" (UniqueName: \"kubernetes.io/projected/69302caa-5f16-492a-8fbc-b0edbccb488f-kube-api-access-tdtrz\") pod \"maas-controller-d5f7f7fc6-p62cl\" (UID: \"69302caa-5f16-492a-8fbc-b0edbccb488f\") " pod="opendatahub/maas-controller-d5f7f7fc6-p62cl"
Sep 15 09:24:20.970798 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:20.970758    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:21.022283 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:21.022212    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:21.065475 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:21.065446    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69302caa-5f16-492a-8fbc-b0edbccb488f-webhook-cert\") pod \"maas-controller-d5f7f7fc6-p62cl\" (UID: \"69302caa-5f16-492a-8fbc-b0edbccb488f\") " pod="opendatahub/maas-controller-d5f7f7fc6-p62cl"
Sep 15 09:24:21.065615 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:21.065491    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdtrz\" (UniqueName: \"kubernetes.io/projected/69302caa-5f16-492a-8fbc-b0edbccb488f-kube-api-access-tdtrz\") pod \"maas-controller-d5f7f7fc6-p62cl\" (UID: \"69302caa-5f16-492a-8fbc-b0edbccb488f\") " pod="opendatahub/maas-controller-d5f7f7fc6-p62cl"
Sep 15 09:24:21.065615 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:21.065521    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69302caa-5f16-492a-8fbc-b0edbccb488f-metrics-certs\") pod \"maas-controller-d5f7f7fc6-p62cl\" (UID: \"69302caa-5f16-492a-8fbc-b0edbccb488f\") " pod="opendatahub/maas-controller-d5f7f7fc6-p62cl"
Sep 15 09:24:21.068044 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:21.068022    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69302caa-5f16-492a-8fbc-b0edbccb488f-metrics-certs\") pod \"maas-controller-d5f7f7fc6-p62cl\" (UID: \"69302caa-5f16-492a-8fbc-b0edbccb488f\") " pod="opendatahub/maas-controller-d5f7f7fc6-p62cl"
Sep 15 09:24:21.068145 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:21.068092    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69302caa-5f16-492a-8fbc-b0edbccb488f-webhook-cert\") pod \"maas-controller-d5f7f7fc6-p62cl\" (UID: \"69302caa-5f16-492a-8fbc-b0edbccb488f\") " pod="opendatahub/maas-controller-d5f7f7fc6-p62cl"
Sep 15 09:24:21.073593 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:21.073574    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdtrz\" (UniqueName: \"kubernetes.io/projected/69302caa-5f16-492a-8fbc-b0edbccb488f-kube-api-access-tdtrz\") pod \"maas-controller-d5f7f7fc6-p62cl\" (UID: \"69302caa-5f16-492a-8fbc-b0edbccb488f\") " pod="opendatahub/maas-controller-d5f7f7fc6-p62cl"
Sep 15 09:24:21.260082 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:21.260019    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d5f7f7fc6-p62cl"
Sep 15 09:24:21.532757 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:21.532735    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d5f7f7fc6-p62cl"]
Sep 15 09:24:21.535018 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:24:21.534977    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69302caa_5f16_492a_8fbc_b0edbccb488f.slice/crio-dc586fa7e7b9497f289164d470298e01cf697cff8cab5938e4f1a7b27e03feef WatchSource:0}: Error finding container dc586fa7e7b9497f289164d470298e01cf697cff8cab5938e4f1a7b27e03feef: Status 404 returned error can't find the container with id dc586fa7e7b9497f289164d470298e01cf697cff8cab5938e4f1a7b27e03feef
Sep 15 09:24:21.844379 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:21.844345    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d5f7f7fc6-p62cl" event={"ID":"69302caa-5f16-492a-8fbc-b0edbccb488f","Type":"ContainerStarted","Data":"dc586fa7e7b9497f289164d470298e01cf697cff8cab5938e4f1a7b27e03feef"}
Sep 15 09:24:23.782661 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:23.782578    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:23.855754 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:23.855720    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d5f7f7fc6-p62cl" event={"ID":"69302caa-5f16-492a-8fbc-b0edbccb488f","Type":"ContainerStarted","Data":"09689571894f418b9dc7779aef6e2aa1a486fe9bde8140726698a526d6d7e874"}
Sep 15 09:24:23.855928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:23.855841    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d5f7f7fc6-p62cl"
Sep 15 09:24:23.884705 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:23.884655    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d5f7f7fc6-p62cl" podStartSLOduration=1.673230982 podStartE2EDuration="3.884640871s" totalImagesPullingTime="2.211409889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:24:23.882816187 +0000 UTC m=+627.532232290" watchObservedRunningTime="2026-09-15 09:24:23.884640871 +0000 UTC m=+627.534056963"
Sep 15 09:24:23.909472 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:23.909425    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:34.867649 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:34.867620    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d5f7f7fc6-p62cl"
Sep 15 09:24:37.321027 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:37.320994    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:44.924052 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:44.924004    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:54.059728 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:54.059694    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:54.158240 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:54.158209    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:55.634712 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:55.634679    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:55.736604 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:55.736543    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:55.806327 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:55.806297    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:56.123009 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.122975    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:56.224432 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.224387    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:56.230992 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.230968    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-szd7z"]
Sep 15 09:24:56.234304 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.234282    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-szd7z"
Sep 15 09:24:56.236621 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.236598    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pz7sl\""
Sep 15 09:24:56.236873 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.236858    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 15 09:24:56.248692 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.248661    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-szd7z"]
Sep 15 09:24:56.284140 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.284111    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pljbs"]
Sep 15 09:24:56.287471 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.287455    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-pljbs"
Sep 15 09:24:56.295589 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.295189    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pljbs"]
Sep 15 09:24:56.353566 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.353522    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fcbe6bc-94d4-4557-bb35-1e664c775fa0-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pljbs\" (UID: \"9fcbe6bc-94d4-4557-bb35-1e664c775fa0\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pljbs"
Sep 15 09:24:56.353780 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.353583    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77pkb\" (UniqueName: \"kubernetes.io/projected/64ea1d0e-c8c9-4b1f-babe-11a283e0538e-kube-api-access-77pkb\") pod \"payload-pre-processing-59fbc47bf8-szd7z\" (UID: \"64ea1d0e-c8c9-4b1f-babe-11a283e0538e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-szd7z"
Sep 15 09:24:56.353780 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.353641    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5wnh\" (UniqueName: \"kubernetes.io/projected/9fcbe6bc-94d4-4557-bb35-1e664c775fa0-kube-api-access-q5wnh\") pod \"payload-processing-5b54b7fbb7-pljbs\" (UID: \"9fcbe6bc-94d4-4557-bb35-1e664c775fa0\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pljbs"
Sep 15 09:24:56.353780 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.353728    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64ea1d0e-c8c9-4b1f-babe-11a283e0538e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-szd7z\" (UID: \"64ea1d0e-c8c9-4b1f-babe-11a283e0538e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-szd7z"
Sep 15 09:24:56.419824 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.419790    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:24:56.454832 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.454788    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64ea1d0e-c8c9-4b1f-babe-11a283e0538e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-szd7z\" (UID: \"64ea1d0e-c8c9-4b1f-babe-11a283e0538e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-szd7z"
Sep 15 09:24:56.455032 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.454851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fcbe6bc-94d4-4557-bb35-1e664c775fa0-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pljbs\" (UID: \"9fcbe6bc-94d4-4557-bb35-1e664c775fa0\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pljbs"
Sep 15 09:24:56.455032 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.454896    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77pkb\" (UniqueName: \"kubernetes.io/projected/64ea1d0e-c8c9-4b1f-babe-11a283e0538e-kube-api-access-77pkb\") pod \"payload-pre-processing-59fbc47bf8-szd7z\" (UID: \"64ea1d0e-c8c9-4b1f-babe-11a283e0538e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-szd7z"
Sep 15 09:24:56.455032 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.454938    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5wnh\" (UniqueName: \"kubernetes.io/projected/9fcbe6bc-94d4-4557-bb35-1e664c775fa0-kube-api-access-q5wnh\") pod \"payload-processing-5b54b7fbb7-pljbs\" (UID: \"9fcbe6bc-94d4-4557-bb35-1e664c775fa0\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pljbs"
Sep 15 09:24:56.455643 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.455614    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64ea1d0e-c8c9-4b1f-babe-11a283e0538e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-szd7z\" (UID: \"64ea1d0e-c8c9-4b1f-babe-11a283e0538e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-szd7z"
Sep 15 09:24:56.456054 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.455678    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fcbe6bc-94d4-4557-bb35-1e664c775fa0-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pljbs\" (UID: \"9fcbe6bc-94d4-4557-bb35-1e664c775fa0\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pljbs"
Sep 15 09:24:56.463870 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.463831    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5wnh\" (UniqueName: \"kubernetes.io/projected/9fcbe6bc-94d4-4557-bb35-1e664c775fa0-kube-api-access-q5wnh\") pod \"payload-processing-5b54b7fbb7-pljbs\" (UID: \"9fcbe6bc-94d4-4557-bb35-1e664c775fa0\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pljbs"
Sep 15 09:24:56.464015 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.463835    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77pkb\" (UniqueName: \"kubernetes.io/projected/64ea1d0e-c8c9-4b1f-babe-11a283e0538e-kube-api-access-77pkb\") pod \"payload-pre-processing-59fbc47bf8-szd7z\" (UID: \"64ea1d0e-c8c9-4b1f-babe-11a283e0538e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-szd7z"
Sep 15 09:24:56.549811 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.549747    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-szd7z"
Sep 15 09:24:56.600330 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.600298    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-pljbs"
Sep 15 09:24:56.828463 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.828434    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-szd7z"]
Sep 15 09:24:56.830694 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:24:56.830665    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64ea1d0e_c8c9_4b1f_babe_11a283e0538e.slice/crio-d4092202e7e20a8dd59f6aea20c68b67fabe72418668f73eac2243e6f7c1a118 WatchSource:0}: Error finding container d4092202e7e20a8dd59f6aea20c68b67fabe72418668f73eac2243e6f7c1a118: Status 404 returned error can't find the container with id d4092202e7e20a8dd59f6aea20c68b67fabe72418668f73eac2243e6f7c1a118
Sep 15 09:24:56.891177 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:56.891147    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pljbs"]
Sep 15 09:24:56.892895 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:24:56.892870    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fcbe6bc_94d4_4557_bb35_1e664c775fa0.slice/crio-be86aa93ff6aabcc43e6e9548bde5e81a39d016891800f6cb626fbdf149e72a7 WatchSource:0}: Error finding container be86aa93ff6aabcc43e6e9548bde5e81a39d016891800f6cb626fbdf149e72a7: Status 404 returned error can't find the container with id be86aa93ff6aabcc43e6e9548bde5e81a39d016891800f6cb626fbdf149e72a7
Sep 15 09:24:57.014135 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:57.014046    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-pljbs" event={"ID":"9fcbe6bc-94d4-4557-bb35-1e664c775fa0","Type":"ContainerStarted","Data":"be86aa93ff6aabcc43e6e9548bde5e81a39d016891800f6cb626fbdf149e72a7"}
Sep 15 09:24:57.015342 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:24:57.015315    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-szd7z" event={"ID":"64ea1d0e-c8c9-4b1f-babe-11a283e0538e","Type":"ContainerStarted","Data":"d4092202e7e20a8dd59f6aea20c68b67fabe72418668f73eac2243e6f7c1a118"}
Sep 15 09:25:00.037023 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:00.036982    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-szd7z" event={"ID":"64ea1d0e-c8c9-4b1f-babe-11a283e0538e","Type":"ContainerStarted","Data":"8d5ed21c14ef3739681a044dc8f00ebc8d307b7fc84f60161c41446e8a141606"}
Sep 15 09:25:00.037504 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:00.037140    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-szd7z"
Sep 15 09:25:00.038582 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:00.038558    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-pljbs" event={"ID":"9fcbe6bc-94d4-4557-bb35-1e664c775fa0","Type":"ContainerStarted","Data":"af494a56a5dbfcf948f371fc340b51cb586e58dd0cea6db67cb0e99e48efb54e"}
Sep 15 09:25:00.038703 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:00.038668    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-pljbs"
Sep 15 09:25:00.052873 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:00.052821    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-szd7z" podStartSLOduration=1.55893581 podStartE2EDuration="4.052805826s" totalImagesPullingTime="2.493870016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:25:00.051246766 +0000 UTC m=+663.700662861" watchObservedRunningTime="2026-09-15 09:25:00.052805826 +0000 UTC m=+663.702221920"
Sep 15 09:25:00.066652 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:00.066603    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-pljbs" podStartSLOduration=1.628813984 podStartE2EDuration="4.066584873s" totalImagesPullingTime="2.437770889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:25:00.065670713 +0000 UTC m=+663.715086806" watchObservedRunningTime="2026-09-15 09:25:00.066584873 +0000 UTC m=+663.716000970"
Sep 15 09:25:06.770443 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:06.770405    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:25:06.860134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:06.860102    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:25:11.046347 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:11.046319    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-pljbs"
Sep 15 09:25:11.046827 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:11.046498    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-szd7z"
Sep 15 09:25:23.095447 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:23.095409    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:25:30.034025 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:30.033991    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:25:40.780040 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:40.780007    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:25:40.880117 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:40.880081    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:25:42.295436 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.295395    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"]
Sep 15 09:25:42.302351 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.302326    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.304937 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.304911    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 09:25:42.305045 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.304961    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 09:25:42.305955 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.305937    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d8dng\""
Sep 15 09:25:42.306080 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.305951    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 15 09:25:42.308687 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.308667    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"]
Sep 15 09:25:42.320578 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.320548    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:25:42.348731 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.348699    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.348881 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.348748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gcj6\" (UniqueName: \"kubernetes.io/projected/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-kube-api-access-8gcj6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.348881 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.348815    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.348881 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.348843    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.348881 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.348861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.349273 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.348915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.449850 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.449816    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.450035 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.449880    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gcj6\" (UniqueName: \"kubernetes.io/projected/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-kube-api-access-8gcj6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.450035 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.449928    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.450035 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.449962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.450170 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.450090    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.450170 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.450143    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.450332 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.450309    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.450494 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.450461    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.450607 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.450568    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.452385 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.452366    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.452527 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.452512    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.457515 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.457491    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gcj6\" (UniqueName: \"kubernetes.io/projected/d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b-kube-api-access-8gcj6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6\" (UID: \"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.613576 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.613490    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:42.886440 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.886416    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"]
Sep 15 09:25:42.888681 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:25:42.888653    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34a2217_1c7c_4ddc_afe3_4ffe4e60bc8b.slice/crio-c659541c8970f41ffb401d8f0ff28d0f0ee8f453a276b593b07fc87e49075e5a WatchSource:0}: Error finding container c659541c8970f41ffb401d8f0ff28d0f0ee8f453a276b593b07fc87e49075e5a: Status 404 returned error can't find the container with id c659541c8970f41ffb401d8f0ff28d0f0ee8f453a276b593b07fc87e49075e5a
Sep 15 09:25:42.890021 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:42.890003    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:25:43.252024 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:43.251982    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6" event={"ID":"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b","Type":"ContainerStarted","Data":"c659541c8970f41ffb401d8f0ff28d0f0ee8f453a276b593b07fc87e49075e5a"}
Sep 15 09:25:44.259863 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:44.259754    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6" event={"ID":"d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b","Type":"ContainerStarted","Data":"63a0862965bc67a389b4769ee92ef09b8ffda6b3a55f5799528d6ab34ceace49"}
Sep 15 09:25:44.277593 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:44.277542    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6" podStartSLOduration=1.264620882 podStartE2EDuration="2.277527343s" totalImagesPullingTime="1.012906461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:25:44.275409981 +0000 UTC m=+707.924826075" watchObservedRunningTime="2026-09-15 09:25:44.277527343 +0000 UTC m=+707.926943435"
Sep 15 09:25:47.099655 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.099619    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"]
Sep 15 09:25:47.104110 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.104083    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.106487 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.106461    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 15 09:25:47.115478 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.115455    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"]
Sep 15 09:25:47.133394 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.133369    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:25:47.192293 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.192256    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f95f7748-f49d-4602-8478-7cd686e23d8f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.192470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.192311    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv6n7\" (UniqueName: \"kubernetes.io/projected/f95f7748-f49d-4602-8478-7cd686e23d8f-kube-api-access-jv6n7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.192470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.192336    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f95f7748-f49d-4602-8478-7cd686e23d8f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.192470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.192376    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f95f7748-f49d-4602-8478-7cd686e23d8f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.192470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.192390    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f95f7748-f49d-4602-8478-7cd686e23d8f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.192470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.192414    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f95f7748-f49d-4602-8478-7cd686e23d8f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.292939 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.292908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f95f7748-f49d-4602-8478-7cd686e23d8f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.293114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.292969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv6n7\" (UniqueName: \"kubernetes.io/projected/f95f7748-f49d-4602-8478-7cd686e23d8f-kube-api-access-jv6n7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.293114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.292992    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f95f7748-f49d-4602-8478-7cd686e23d8f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.293114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.293023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f95f7748-f49d-4602-8478-7cd686e23d8f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.293114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.293040    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f95f7748-f49d-4602-8478-7cd686e23d8f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.293114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.293055    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f95f7748-f49d-4602-8478-7cd686e23d8f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.293400 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.293375    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f95f7748-f49d-4602-8478-7cd686e23d8f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.293464 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.293447    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f95f7748-f49d-4602-8478-7cd686e23d8f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.293510 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.293478    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f95f7748-f49d-4602-8478-7cd686e23d8f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.295378 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.295357    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f95f7748-f49d-4602-8478-7cd686e23d8f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.295566 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.295550    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f95f7748-f49d-4602-8478-7cd686e23d8f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.300181 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.300161    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv6n7\" (UniqueName: \"kubernetes.io/projected/f95f7748-f49d-4602-8478-7cd686e23d8f-kube-api-access-jv6n7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-drjqk\" (UID: \"f95f7748-f49d-4602-8478-7cd686e23d8f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.416696 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.416664    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:47.692858 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:47.692831    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"]
Sep 15 09:25:47.694618 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:25:47.694578    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf95f7748_f49d_4602_8478_7cd686e23d8f.slice/crio-37217c13da558aa355c467c635f97f607fc13f3a9df56567a49641aea1acf9e2 WatchSource:0}: Error finding container 37217c13da558aa355c467c635f97f607fc13f3a9df56567a49641aea1acf9e2: Status 404 returned error can't find the container with id 37217c13da558aa355c467c635f97f607fc13f3a9df56567a49641aea1acf9e2
Sep 15 09:25:48.279199 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:48.279162    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk" event={"ID":"f95f7748-f49d-4602-8478-7cd686e23d8f","Type":"ContainerStarted","Data":"8e582ee59aede1cee9b5ff8e394825f1d35c72a707eb6faa1f677492325c1bfa"}
Sep 15 09:25:48.279580 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:48.279221    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk" event={"ID":"f95f7748-f49d-4602-8478-7cd686e23d8f","Type":"ContainerStarted","Data":"37217c13da558aa355c467c635f97f607fc13f3a9df56567a49641aea1acf9e2"}
Sep 15 09:25:48.295919 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:48.295871    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk" podStartSLOduration=1.123431985 podStartE2EDuration="1.295855427s" totalImagesPullingTime="172.423442ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:25:48.294043815 +0000 UTC m=+711.943459910" watchObservedRunningTime="2026-09-15 09:25:48.295855427 +0000 UTC m=+711.945271519"
Sep 15 09:25:52.613955 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:52.613919    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:52.614348 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:52.613994    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:52.627137 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:52.627114    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:53.220239 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:53.220209    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:25:53.316094 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:53.316059    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6"
Sep 15 09:25:57.417333 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:57.417298    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:57.417803 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:57.417409    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:57.429879 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:57.429856    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:25:58.339600 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:25:58.339573    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-drjqk"
Sep 15 09:26:08.337894 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:26:08.337838    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:26:17.132326 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:26:17.132292    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:22.863341 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:22.863300    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:30.144434 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:30.144396    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c4f5f6dd-krqn4"]
Sep 15 09:27:30.148285 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:30.148259    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c4f5f6dd-krqn4"
Sep 15 09:27:30.155907 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:30.155869    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c4f5f6dd-krqn4"]
Sep 15 09:27:30.293363 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:30.293329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55afdde3-1232-4b3c-9cfc-da32d15b333b-tls-cert\") pod \"authorino-c4f5f6dd-krqn4\" (UID: \"55afdde3-1232-4b3c-9cfc-da32d15b333b\") " pod="kuadrant-system/authorino-c4f5f6dd-krqn4"
Sep 15 09:27:30.293565 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:30.293392    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppr6f\" (UniqueName: \"kubernetes.io/projected/55afdde3-1232-4b3c-9cfc-da32d15b333b-kube-api-access-ppr6f\") pod \"authorino-c4f5f6dd-krqn4\" (UID: \"55afdde3-1232-4b3c-9cfc-da32d15b333b\") " pod="kuadrant-system/authorino-c4f5f6dd-krqn4"
Sep 15 09:27:30.394183 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:30.394147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppr6f\" (UniqueName: \"kubernetes.io/projected/55afdde3-1232-4b3c-9cfc-da32d15b333b-kube-api-access-ppr6f\") pod \"authorino-c4f5f6dd-krqn4\" (UID: \"55afdde3-1232-4b3c-9cfc-da32d15b333b\") " pod="kuadrant-system/authorino-c4f5f6dd-krqn4"
Sep 15 09:27:30.394392 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:30.394212    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55afdde3-1232-4b3c-9cfc-da32d15b333b-tls-cert\") pod \"authorino-c4f5f6dd-krqn4\" (UID: \"55afdde3-1232-4b3c-9cfc-da32d15b333b\") " pod="kuadrant-system/authorino-c4f5f6dd-krqn4"
Sep 15 09:27:30.396848 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:30.396789    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55afdde3-1232-4b3c-9cfc-da32d15b333b-tls-cert\") pod \"authorino-c4f5f6dd-krqn4\" (UID: \"55afdde3-1232-4b3c-9cfc-da32d15b333b\") " pod="kuadrant-system/authorino-c4f5f6dd-krqn4"
Sep 15 09:27:30.401700 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:30.401671    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppr6f\" (UniqueName: \"kubernetes.io/projected/55afdde3-1232-4b3c-9cfc-da32d15b333b-kube-api-access-ppr6f\") pod \"authorino-c4f5f6dd-krqn4\" (UID: \"55afdde3-1232-4b3c-9cfc-da32d15b333b\") " pod="kuadrant-system/authorino-c4f5f6dd-krqn4"
Sep 15 09:27:30.457863 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:30.457836    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c4f5f6dd-krqn4"
Sep 15 09:27:30.726444 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:30.726420    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c4f5f6dd-krqn4"]
Sep 15 09:27:30.728679 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:27:30.728656    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55afdde3_1232_4b3c_9cfc_da32d15b333b.slice/crio-3be88ba0d975c4aba685b333cb1469f86b20b6e3276b0cdf12596ac443684a26 WatchSource:0}: Error finding container 3be88ba0d975c4aba685b333cb1469f86b20b6e3276b0cdf12596ac443684a26: Status 404 returned error can't find the container with id 3be88ba0d975c4aba685b333cb1469f86b20b6e3276b0cdf12596ac443684a26
Sep 15 09:27:30.788673 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:30.788642    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c4f5f6dd-krqn4" event={"ID":"55afdde3-1232-4b3c-9cfc-da32d15b333b","Type":"ContainerStarted","Data":"3be88ba0d975c4aba685b333cb1469f86b20b6e3276b0cdf12596ac443684a26"}
Sep 15 09:27:32.806432 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:32.806395    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c4f5f6dd-krqn4" event={"ID":"55afdde3-1232-4b3c-9cfc-da32d15b333b","Type":"ContainerStarted","Data":"4a2e75771a6f096637ce3cb13a7fc690273333d76177e663882f12b66fe42acb"}
Sep 15 09:27:32.824396 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:32.824343    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c4f5f6dd-krqn4" podStartSLOduration=1.533052982 podStartE2EDuration="2.824328341s" totalImagesPullingTime="1.291275359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:27:32.823001635 +0000 UTC m=+816.472417729" watchObservedRunningTime="2026-09-15 09:27:32.824328341 +0000 UTC m=+816.473744433"
Sep 15 09:27:32.864574 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:32.864544    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-686d496fd9-qvvzf"]
Sep 15 09:27:32.864996 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:32.864967    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-686d496fd9-qvvzf" podUID="76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5" containerName="authorino" containerID="cri-o://c313671f6f077268324be11edc13daa1d063d9fec8163306b4b3efaafe15bb2d" gracePeriod=30
Sep 15 09:27:33.133454 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.133415    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-686d496fd9-qvvzf"
Sep 15 09:27:33.316211 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.316159    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5-tls-cert\") pod \"76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5\" (UID: \"76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5\") "
Sep 15 09:27:33.316211 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.316216    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xdrg\" (UniqueName: \"kubernetes.io/projected/76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5-kube-api-access-2xdrg\") pod \"76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5\" (UID: \"76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5\") "
Sep 15 09:27:33.318374 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.318334    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5-kube-api-access-2xdrg" (OuterVolumeSpecName: "kube-api-access-2xdrg") pod "76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5" (UID: "76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5"). InnerVolumeSpecName "kube-api-access-2xdrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:27:33.327480 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.327451    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5" (UID: "76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:27:33.398476 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.398440    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:33.417728 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.417685    2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5-tls-cert\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:27:33.417728 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.417713    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xdrg\" (UniqueName: \"kubernetes.io/projected/76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5-kube-api-access-2xdrg\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:27:33.498399 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.498333    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:33.813427 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.813336    2575 generic.go:356] "Generic (PLEG): container finished" podID="76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5" containerID="c313671f6f077268324be11edc13daa1d063d9fec8163306b4b3efaafe15bb2d" exitCode=0
Sep 15 09:27:33.813427 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.813378    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-686d496fd9-qvvzf" event={"ID":"76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5","Type":"ContainerDied","Data":"c313671f6f077268324be11edc13daa1d063d9fec8163306b4b3efaafe15bb2d"}
Sep 15 09:27:33.813928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.813394    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-686d496fd9-qvvzf"
Sep 15 09:27:33.813928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.813438    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-686d496fd9-qvvzf" event={"ID":"76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5","Type":"ContainerDied","Data":"89125044997c2d40b1888e4b12bf11a39be84fb1fec9bf5d6154ad37f81540bb"}
Sep 15 09:27:33.813928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.813467    2575 scope.go:117] "RemoveContainer" containerID="c313671f6f077268324be11edc13daa1d063d9fec8163306b4b3efaafe15bb2d"
Sep 15 09:27:33.824140 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.824121    2575 scope.go:117] "RemoveContainer" containerID="c313671f6f077268324be11edc13daa1d063d9fec8163306b4b3efaafe15bb2d"
Sep 15 09:27:33.824453 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:27:33.824433    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c313671f6f077268324be11edc13daa1d063d9fec8163306b4b3efaafe15bb2d\": container with ID starting with c313671f6f077268324be11edc13daa1d063d9fec8163306b4b3efaafe15bb2d not found: ID does not exist" containerID="c313671f6f077268324be11edc13daa1d063d9fec8163306b4b3efaafe15bb2d"
Sep 15 09:27:33.824555 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.824460    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c313671f6f077268324be11edc13daa1d063d9fec8163306b4b3efaafe15bb2d"} err="failed to get container status \"c313671f6f077268324be11edc13daa1d063d9fec8163306b4b3efaafe15bb2d\": rpc error: code = NotFound desc = could not find container \"c313671f6f077268324be11edc13daa1d063d9fec8163306b4b3efaafe15bb2d\": container with ID starting with c313671f6f077268324be11edc13daa1d063d9fec8163306b4b3efaafe15bb2d not found: ID does not exist"
Sep 15 09:27:33.833361 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.833337    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-686d496fd9-qvvzf"]
Sep 15 09:27:33.837297 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:33.837276    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-686d496fd9-qvvzf"]
Sep 15 09:27:34.491621 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:34.491588    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:34.592478 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:34.592447    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:34.859311 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:34.859217    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5" path="/var/lib/kubelet/pods/76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5/volumes"
Sep 15 09:27:34.934894 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:34.934863    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:51.036510 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.036472    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:51.457714 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.457679    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"]
Sep 15 09:27:51.458534 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.458280    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5" containerName="authorino"
Sep 15 09:27:51.458534 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.458301    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5" containerName="authorino"
Sep 15 09:27:51.458898 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.458878    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="76caafaf-fb3f-4dc1-bf1f-fdb81fe0d9d5" containerName="authorino"
Sep 15 09:27:51.471459 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.471433    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.473692 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.473664    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"]
Sep 15 09:27:51.474362 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.474339    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-e76bac-openshift-default-dockercfg-dlzxt\""
Sep 15 09:27:51.474477 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.474378    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 09:27:51.549566 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.549530    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-workload-certs\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.549566 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.549567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-token\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.549849 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.549596    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwfj5\" (UniqueName: \"kubernetes.io/projected/6afb041d-1884-4e0b-ac8c-8e14813068c2-kube-api-access-qwfj5\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.549849 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.549621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-podinfo\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.549849 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.549684    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6afb041d-1884-4e0b-ac8c-8e14813068c2-istiod-ca-cert\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.549849 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.549811    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-workload-socket\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.550022 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.549929    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-envoy\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.550022 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.549960    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-data\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.550097 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.550042    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-credential-socket\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.650659 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.650620    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-podinfo\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.650659 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.650657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6afb041d-1884-4e0b-ac8c-8e14813068c2-istiod-ca-cert\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.651009 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.650677    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-workload-socket\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.651009 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.650779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-envoy\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.651009 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.650889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-data\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.651009 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.650950    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-credential-socket\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.651009 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.650997    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-workload-certs\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.651270 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.651022    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-token\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.651270 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.651050    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwfj5\" (UniqueName: \"kubernetes.io/projected/6afb041d-1884-4e0b-ac8c-8e14813068c2-kube-api-access-qwfj5\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.651270 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.651241    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-workload-socket\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.651427 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.651280    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-data\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.651543 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.651518    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-credential-socket\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.651669 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.651506    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-workload-certs\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.651921 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.651901    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6afb041d-1884-4e0b-ac8c-8e14813068c2-istiod-ca-cert\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.653246 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.653221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-envoy\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.653721 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.653701    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-podinfo\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.660037 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.660011    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwfj5\" (UniqueName: \"kubernetes.io/projected/6afb041d-1884-4e0b-ac8c-8e14813068c2-kube-api-access-qwfj5\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.660264 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.660244    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-token\") pod \"e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") " pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.670648 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.670623    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:51.770579 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.770495    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:51.784222 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.784193    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:51.872556 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.872476    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:51.938613 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:51.938576    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:52.062103 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:52.062075    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"]
Sep 15 09:27:52.064811 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:27:52.064741    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6afb041d_1884_4e0b_ac8c_8e14813068c2.slice/crio-12e0099069534a874113f45e174ee23d2e7d70ceadeb874c7a416576932a3cee WatchSource:0}: Error finding container 12e0099069534a874113f45e174ee23d2e7d70ceadeb874c7a416576932a3cee: Status 404 returned error can't find the container with id 12e0099069534a874113f45e174ee23d2e7d70ceadeb874c7a416576932a3cee
Sep 15 09:27:52.574631 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:52.574598    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:52.674998 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:52.674962    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:52.919092 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:52.919060    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh" event={"ID":"6afb041d-1884-4e0b-ac8c-8e14813068c2","Type":"ContainerStarted","Data":"12e0099069534a874113f45e174ee23d2e7d70ceadeb874c7a416576932a3cee"}
Sep 15 09:27:53.049816 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:53.049759    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:54.154947 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:54.154863    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:54.247732 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:54.247692    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:54.345049 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:54.345010    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:55.375900 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:55.375863    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:27:55.376186 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:55.375953    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:27:55.376186 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:55.375980    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:27:55.553366 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:55.553335    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:55.653807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:55.653749    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:55.877048 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:55.877008    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:55.941715 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:55.941623    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh" event={"ID":"6afb041d-1884-4e0b-ac8c-8e14813068c2","Type":"ContainerStarted","Data":"0245bec65e56b0d31e0dced87398f5ecd5b8ebad5454b71bc81bfb4e37a5fe05"}
Sep 15 09:27:55.965404 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:55.965357    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh" podStartSLOduration=1.657097302 podStartE2EDuration="4.965338513s" totalImagesPullingTime="3.308241211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:27:55.964222514 +0000 UTC m=+839.613638619" watchObservedRunningTime="2026-09-15 09:27:55.965338513 +0000 UTC m=+839.614754606"
Sep 15 09:27:56.079842 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.079815    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:56.165150 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.165110    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:56.169204 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.169178    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"]
Sep 15 09:27:56.172922 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.172903    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"
Sep 15 09:27:56.175298 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.175278    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-7a31d6\""
Sep 15 09:27:56.181990 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.181967    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"]
Sep 15 09:27:56.196173 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.196099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk9hf\" (UniqueName: \"kubernetes.io/projected/fece0b2e-61c3-418e-8585-8f3f6d7d66c3-kube-api-access-rk9hf\") pod \"payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn\" (UID: \"fece0b2e-61c3-418e-8585-8f3f6d7d66c3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"
Sep 15 09:27:56.196173 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.196169    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fece0b2e-61c3-418e-8585-8f3f6d7d66c3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn\" (UID: \"fece0b2e-61c3-418e-8585-8f3f6d7d66c3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"
Sep 15 09:27:56.206662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.206639    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"]
Sep 15 09:27:56.210235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.210218    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"
Sep 15 09:27:56.212593 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.212573    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-7a31d6-dockercfg-8h9bt\""
Sep 15 09:27:56.223638 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.223616    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"]
Sep 15 09:27:56.297729 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.297699    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knkwg\" (UniqueName: \"kubernetes.io/projected/f7f21bf6-78bd-416e-ab60-d8a6f5234695-kube-api-access-knkwg\") pod \"payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t\" (UID: \"f7f21bf6-78bd-416e-ab60-d8a6f5234695\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"
Sep 15 09:27:56.297729 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.297733    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7f21bf6-78bd-416e-ab60-d8a6f5234695-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t\" (UID: \"f7f21bf6-78bd-416e-ab60-d8a6f5234695\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"
Sep 15 09:27:56.297992 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.297776    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk9hf\" (UniqueName: \"kubernetes.io/projected/fece0b2e-61c3-418e-8585-8f3f6d7d66c3-kube-api-access-rk9hf\") pod \"payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn\" (UID: \"fece0b2e-61c3-418e-8585-8f3f6d7d66c3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"
Sep 15 09:27:56.297992 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.297866    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fece0b2e-61c3-418e-8585-8f3f6d7d66c3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn\" (UID: \"fece0b2e-61c3-418e-8585-8f3f6d7d66c3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"
Sep 15 09:27:56.298879 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.298854    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fece0b2e-61c3-418e-8585-8f3f6d7d66c3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn\" (UID: \"fece0b2e-61c3-418e-8585-8f3f6d7d66c3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"
Sep 15 09:27:56.305625 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.305600    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk9hf\" (UniqueName: \"kubernetes.io/projected/fece0b2e-61c3-418e-8585-8f3f6d7d66c3-kube-api-access-rk9hf\") pod \"payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn\" (UID: \"fece0b2e-61c3-418e-8585-8f3f6d7d66c3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"
Sep 15 09:27:56.399146 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.399112    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knkwg\" (UniqueName: \"kubernetes.io/projected/f7f21bf6-78bd-416e-ab60-d8a6f5234695-kube-api-access-knkwg\") pod \"payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t\" (UID: \"f7f21bf6-78bd-416e-ab60-d8a6f5234695\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"
Sep 15 09:27:56.399146 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.399144    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7f21bf6-78bd-416e-ab60-d8a6f5234695-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t\" (UID: \"f7f21bf6-78bd-416e-ab60-d8a6f5234695\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"
Sep 15 09:27:56.399788 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.399750    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7f21bf6-78bd-416e-ab60-d8a6f5234695-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t\" (UID: \"f7f21bf6-78bd-416e-ab60-d8a6f5234695\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"
Sep 15 09:27:56.408486 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.408457    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knkwg\" (UniqueName: \"kubernetes.io/projected/f7f21bf6-78bd-416e-ab60-d8a6f5234695-kube-api-access-knkwg\") pod \"payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t\" (UID: \"f7f21bf6-78bd-416e-ab60-d8a6f5234695\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"
Sep 15 09:27:56.484146 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.484071    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"
Sep 15 09:27:56.520905 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.520873    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"
Sep 15 09:27:56.524282 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.524107    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:56.582210 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.582136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:56.681733 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.681697    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:56.770489 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.770468    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"]
Sep 15 09:27:56.772660 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:27:56.772635    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfece0b2e_61c3_418e_8585_8f3f6d7d66c3.slice/crio-3657851cb912a930dd19fd323f3dd581053f161c7d51136bff697a5972eeeaca WatchSource:0}: Error finding container 3657851cb912a930dd19fd323f3dd581053f161c7d51136bff697a5972eeeaca: Status 404 returned error can't find the container with id 3657851cb912a930dd19fd323f3dd581053f161c7d51136bff697a5972eeeaca
Sep 15 09:27:56.785079 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.785057    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:56.791159 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.791136    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:56.807232 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.807194    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"]
Sep 15 09:27:56.810427 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:27:56.810399    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f21bf6_78bd_416e_ab60_d8a6f5234695.slice/crio-971dded7397bc87197dcb4528f205ffb060c95d28e1779988cf7e405ffc67178 WatchSource:0}: Error finding container 971dded7397bc87197dcb4528f205ffb060c95d28e1779988cf7e405ffc67178: Status 404 returned error can't find the container with id 971dded7397bc87197dcb4528f205ffb060c95d28e1779988cf7e405ffc67178
Sep 15 09:27:56.951588 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.951548    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn" event={"ID":"fece0b2e-61c3-418e-8585-8f3f6d7d66c3","Type":"ContainerStarted","Data":"5321b6d723e0d38714c510471387322116d75f5a4566cedf4e7814e04e3db807"}
Sep 15 09:27:56.951816 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.951613    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn" event={"ID":"fece0b2e-61c3-418e-8585-8f3f6d7d66c3","Type":"ContainerStarted","Data":"3657851cb912a930dd19fd323f3dd581053f161c7d51136bff697a5972eeeaca"}
Sep 15 09:27:56.952019 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.951970    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"
Sep 15 09:27:56.953947 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.953920    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t" event={"ID":"f7f21bf6-78bd-416e-ab60-d8a6f5234695","Type":"ContainerStarted","Data":"9d45460f5438d97ccb6efd2c02587210f43ed79ef373563052b9faf5775a14c8"}
Sep 15 09:27:56.954067 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.953966    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t" event={"ID":"f7f21bf6-78bd-416e-ab60-d8a6f5234695","Type":"ContainerStarted","Data":"971dded7397bc87197dcb4528f205ffb060c95d28e1779988cf7e405ffc67178"}
Sep 15 09:27:56.954067 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.953995    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"
Sep 15 09:27:56.954176 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.954163    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:56.955232 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.955198    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:27:56.970866 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.970829    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn" podStartSLOduration=0.970814943 podStartE2EDuration="970.814943ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:27:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:27:56.969143588 +0000 UTC m=+840.618559681" watchObservedRunningTime="2026-09-15 09:27:56.970814943 +0000 UTC m=+840.620231036"
Sep 15 09:27:56.987158 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:56.987116    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t" podStartSLOduration=0.987105217 podStartE2EDuration="987.105217ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:27:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:27:56.985307273 +0000 UTC m=+840.634723367" watchObservedRunningTime="2026-09-15 09:27:56.987105217 +0000 UTC m=+840.636521310"
Sep 15 09:27:57.150592 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.150562    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:57.231020 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.230991    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:57.371192 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.370101    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"]
Sep 15 09:27:57.374202 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.374179    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"
Sep 15 09:27:57.377339 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.377310    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-c183a5\""
Sep 15 09:27:57.377467 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.377416    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-c183a5-dockercfg-4dd8s\""
Sep 15 09:27:57.381378 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.381359    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"]
Sep 15 09:27:57.406235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.406157    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2863c68-b405-45b7-b60b-932b60f6ff2d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc\" (UID: \"e2863c68-b405-45b7-b60b-932b60f6ff2d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"
Sep 15 09:27:57.406647 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.406344    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7mlk\" (UniqueName: \"kubernetes.io/projected/e2863c68-b405-45b7-b60b-932b60f6ff2d-kube-api-access-f7mlk\") pod \"payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc\" (UID: \"e2863c68-b405-45b7-b60b-932b60f6ff2d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"
Sep 15 09:27:57.440618 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.440594    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"]
Sep 15 09:27:57.444540 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.444515    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"
Sep 15 09:27:57.454338 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.454244    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"]
Sep 15 09:27:57.507142 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.507110    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d80c6f54-686c-4380-94f9-bf97e0ee532d-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj\" (UID: \"d80c6f54-686c-4380-94f9-bf97e0ee532d\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"
Sep 15 09:27:57.507336 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.507150    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9wjt\" (UniqueName: \"kubernetes.io/projected/d80c6f54-686c-4380-94f9-bf97e0ee532d-kube-api-access-d9wjt\") pod \"payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj\" (UID: \"d80c6f54-686c-4380-94f9-bf97e0ee532d\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"
Sep 15 09:27:57.507336 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.507189    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7mlk\" (UniqueName: \"kubernetes.io/projected/e2863c68-b405-45b7-b60b-932b60f6ff2d-kube-api-access-f7mlk\") pod \"payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc\" (UID: \"e2863c68-b405-45b7-b60b-932b60f6ff2d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"
Sep 15 09:27:57.507336 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.507309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2863c68-b405-45b7-b60b-932b60f6ff2d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc\" (UID: \"e2863c68-b405-45b7-b60b-932b60f6ff2d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"
Sep 15 09:27:57.508013 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.507994    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2863c68-b405-45b7-b60b-932b60f6ff2d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc\" (UID: \"e2863c68-b405-45b7-b60b-932b60f6ff2d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"
Sep 15 09:27:57.515886 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.515855    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7mlk\" (UniqueName: \"kubernetes.io/projected/e2863c68-b405-45b7-b60b-932b60f6ff2d-kube-api-access-f7mlk\") pod \"payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc\" (UID: \"e2863c68-b405-45b7-b60b-932b60f6ff2d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"
Sep 15 09:27:57.608235 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.608201    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9wjt\" (UniqueName: \"kubernetes.io/projected/d80c6f54-686c-4380-94f9-bf97e0ee532d-kube-api-access-d9wjt\") pod \"payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj\" (UID: \"d80c6f54-686c-4380-94f9-bf97e0ee532d\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"
Sep 15 09:27:57.608402 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.608341    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d80c6f54-686c-4380-94f9-bf97e0ee532d-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj\" (UID: \"d80c6f54-686c-4380-94f9-bf97e0ee532d\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"
Sep 15 09:27:57.609069 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.609050    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d80c6f54-686c-4380-94f9-bf97e0ee532d-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj\" (UID: \"d80c6f54-686c-4380-94f9-bf97e0ee532d\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"
Sep 15 09:27:57.616162 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.616141    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9wjt\" (UniqueName: \"kubernetes.io/projected/d80c6f54-686c-4380-94f9-bf97e0ee532d-kube-api-access-d9wjt\") pod \"payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj\" (UID: \"d80c6f54-686c-4380-94f9-bf97e0ee532d\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"
Sep 15 09:27:57.687838 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.687741    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"
Sep 15 09:27:57.766458 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.763158    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"
Sep 15 09:27:57.941011 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.940913    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:57.972574 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:57.972545    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"]
Sep 15 09:27:57.973572 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:27:57.973542    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2863c68_b405_45b7_b60b_932b60f6ff2d.slice/crio-a290134f37930279308b17f1a7770db171dbd482132f52a838e3f4b8f52d7456 WatchSource:0}: Error finding container a290134f37930279308b17f1a7770db171dbd482132f52a838e3f4b8f52d7456: Status 404 returned error can't find the container with id a290134f37930279308b17f1a7770db171dbd482132f52a838e3f4b8f52d7456
Sep 15 09:27:58.051920 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:58.051842    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"]
Sep 15 09:27:58.054956 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:27:58.054581    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd80c6f54_686c_4380_94f9_bf97e0ee532d.slice/crio-a9d38a9a46b0b11fb9b79594bc87a627aa998b3e35ee576fec853d5598ab2ff2 WatchSource:0}: Error finding container a9d38a9a46b0b11fb9b79594bc87a627aa998b3e35ee576fec853d5598ab2ff2: Status 404 returned error can't find the container with id a9d38a9a46b0b11fb9b79594bc87a627aa998b3e35ee576fec853d5598ab2ff2
Sep 15 09:27:58.141408 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:58.141334    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:58.242707 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:58.242582    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:58.828315 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:58.828284    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:58.967185 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:58.967153    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc" event={"ID":"e2863c68-b405-45b7-b60b-932b60f6ff2d","Type":"ContainerStarted","Data":"9ead022723d49ff87a16884d9dec85b092fd88877abf82bbcd1591f3bf0c0c8d"}
Sep 15 09:27:58.967417 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:58.967392    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc" event={"ID":"e2863c68-b405-45b7-b60b-932b60f6ff2d","Type":"ContainerStarted","Data":"a290134f37930279308b17f1a7770db171dbd482132f52a838e3f4b8f52d7456"}
Sep 15 09:27:58.967582 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:58.967564    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"
Sep 15 09:27:58.969054 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:58.969013    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj" event={"ID":"d80c6f54-686c-4380-94f9-bf97e0ee532d","Type":"ContainerStarted","Data":"acd17b51be71dc59bf43720b5b57fe18cb0be135de00877cfe69e1ee7421263a"}
Sep 15 09:27:58.969169 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:58.969091    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj" event={"ID":"d80c6f54-686c-4380-94f9-bf97e0ee532d","Type":"ContainerStarted","Data":"a9d38a9a46b0b11fb9b79594bc87a627aa998b3e35ee576fec853d5598ab2ff2"}
Sep 15 09:27:58.983319 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:58.983274    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc" podStartSLOduration=1.983254687 podStartE2EDuration="1.983254687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:27:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:27:58.982397817 +0000 UTC m=+842.631813908" watchObservedRunningTime="2026-09-15 09:27:58.983254687 +0000 UTC m=+842.632670784"
Sep 15 09:27:58.999848 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:58.999807    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj" podStartSLOduration=1.9997937559999999 podStartE2EDuration="1.999793756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:27:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:27:58.998180007 +0000 UTC m=+842.647596103" watchObservedRunningTime="2026-09-15 09:27:58.999793756 +0000 UTC m=+842.649209849"
Sep 15 09:27:59.602667 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:59.602630    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:59.704863 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:59.704829    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:59.806658 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:59.806627    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:59.924164 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:59.924129    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:27:59.974814 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:27:59.974746    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"
Sep 15 09:28:00.028888 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:00.028857    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:00.266565 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:00.266446    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:00.597597 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:00.597497    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:00.698454 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:00.698422    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:01.334008 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:01.333977    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:01.442335 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:01.442306    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:01.541968 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:01.541934    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:01.786179 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:01.786142    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:01.885975 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:01.885935    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:01.892028 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:01.892005    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"]
Sep 15 09:28:01.897970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:01.897938    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"
Sep 15 09:28:01.901297 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:01.901270    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-e76bac\""
Sep 15 09:28:01.901428 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:01.901358    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-e76bac-dockercfg-bw7n4\""
Sep 15 09:28:01.905875 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:01.905852    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"]
Sep 15 09:28:01.923888 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:01.923854    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"]
Sep 15 09:28:01.928080 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:01.928064    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"
Sep 15 09:28:01.939751 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:01.939728    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"]
Sep 15 09:28:01.950553 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:01.950513    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc47t\" (UniqueName: \"kubernetes.io/projected/fb3ffae6-5cd7-4649-89e0-5f673dc96366-kube-api-access-jc47t\") pod \"payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx\" (UID: \"fb3ffae6-5cd7-4649-89e0-5f673dc96366\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"
Sep 15 09:28:01.951028 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:01.950999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb3ffae6-5cd7-4649-89e0-5f673dc96366-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx\" (UID: \"fb3ffae6-5cd7-4649-89e0-5f673dc96366\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"
Sep 15 09:28:02.052352 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.052263    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24d4fdc1-5c00-4e07-88be-d2ca578321f1-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch\" (UID: \"24d4fdc1-5c00-4e07-88be-d2ca578321f1\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"
Sep 15 09:28:02.052352 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.052307    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb3ffae6-5cd7-4649-89e0-5f673dc96366-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx\" (UID: \"fb3ffae6-5cd7-4649-89e0-5f673dc96366\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"
Sep 15 09:28:02.052352 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.052335    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc47t\" (UniqueName: \"kubernetes.io/projected/fb3ffae6-5cd7-4649-89e0-5f673dc96366-kube-api-access-jc47t\") pod \"payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx\" (UID: \"fb3ffae6-5cd7-4649-89e0-5f673dc96366\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"
Sep 15 09:28:02.052610 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.052422    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlhzq\" (UniqueName: \"kubernetes.io/projected/24d4fdc1-5c00-4e07-88be-d2ca578321f1-kube-api-access-tlhzq\") pod \"payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch\" (UID: \"24d4fdc1-5c00-4e07-88be-d2ca578321f1\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"
Sep 15 09:28:02.053024 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.053006    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb3ffae6-5cd7-4649-89e0-5f673dc96366-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx\" (UID: \"fb3ffae6-5cd7-4649-89e0-5f673dc96366\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"
Sep 15 09:28:02.060205 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.060174    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc47t\" (UniqueName: \"kubernetes.io/projected/fb3ffae6-5cd7-4649-89e0-5f673dc96366-kube-api-access-jc47t\") pod \"payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx\" (UID: \"fb3ffae6-5cd7-4649-89e0-5f673dc96366\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"
Sep 15 09:28:02.154062 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.154030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlhzq\" (UniqueName: \"kubernetes.io/projected/24d4fdc1-5c00-4e07-88be-d2ca578321f1-kube-api-access-tlhzq\") pod \"payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch\" (UID: \"24d4fdc1-5c00-4e07-88be-d2ca578321f1\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"
Sep 15 09:28:02.154253 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.154154    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24d4fdc1-5c00-4e07-88be-d2ca578321f1-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch\" (UID: \"24d4fdc1-5c00-4e07-88be-d2ca578321f1\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"
Sep 15 09:28:02.154943 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.154907    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24d4fdc1-5c00-4e07-88be-d2ca578321f1-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch\" (UID: \"24d4fdc1-5c00-4e07-88be-d2ca578321f1\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"
Sep 15 09:28:02.167250 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.167227    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlhzq\" (UniqueName: \"kubernetes.io/projected/24d4fdc1-5c00-4e07-88be-d2ca578321f1-kube-api-access-tlhzq\") pod \"payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch\" (UID: \"24d4fdc1-5c00-4e07-88be-d2ca578321f1\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"
Sep 15 09:28:02.210030 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.210006    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"
Sep 15 09:28:02.239104 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.239077    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"
Sep 15 09:28:02.506194 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.506167    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"]
Sep 15 09:28:02.507646 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:28:02.507621    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb3ffae6_5cd7_4649_89e0_5f673dc96366.slice/crio-b66aa61418b9f9b85ec26f2de5f1ec59ceb068fc17e14c7eb9846b134e28fa35 WatchSource:0}: Error finding container b66aa61418b9f9b85ec26f2de5f1ec59ceb068fc17e14c7eb9846b134e28fa35: Status 404 returned error can't find the container with id b66aa61418b9f9b85ec26f2de5f1ec59ceb068fc17e14c7eb9846b134e28fa35
Sep 15 09:28:02.524334 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.524306    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:02.533003 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.532982    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"]
Sep 15 09:28:02.542090 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:28:02.542064    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24d4fdc1_5c00_4e07_88be_d2ca578321f1.slice/crio-ed034ac88862ef5f5747a043c480b6f5a863068575b83ada0d88212a1d44e40d WatchSource:0}: Error finding container ed034ac88862ef5f5747a043c480b6f5a863068575b83ada0d88212a1d44e40d: Status 404 returned error can't find the container with id ed034ac88862ef5f5747a043c480b6f5a863068575b83ada0d88212a1d44e40d
Sep 15 09:28:02.614348 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.614308    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:02.992466 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.992432    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx" event={"ID":"fb3ffae6-5cd7-4649-89e0-5f673dc96366","Type":"ContainerStarted","Data":"e9b7f6988a825b5c5365b0a5f5442469227f2fd564c65b30971c8da031115ea4"}
Sep 15 09:28:02.992682 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.992497    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx" event={"ID":"fb3ffae6-5cd7-4649-89e0-5f673dc96366","Type":"ContainerStarted","Data":"b66aa61418b9f9b85ec26f2de5f1ec59ceb068fc17e14c7eb9846b134e28fa35"}
Sep 15 09:28:02.992682 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.992570    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"
Sep 15 09:28:02.994286 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.994258    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch" event={"ID":"24d4fdc1-5c00-4e07-88be-d2ca578321f1","Type":"ContainerStarted","Data":"9bf34d31dee6d74f9c42ce4ee565e236fd1cb1844329f773ccd0201b32fb8955"}
Sep 15 09:28:02.994411 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.994307    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch" event={"ID":"24d4fdc1-5c00-4e07-88be-d2ca578321f1","Type":"ContainerStarted","Data":"ed034ac88862ef5f5747a043c480b6f5a863068575b83ada0d88212a1d44e40d"}
Sep 15 09:28:02.994411 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:02.994335    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"
Sep 15 09:28:03.031062 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:03.031009    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx" podStartSLOduration=2.030991827 podStartE2EDuration="2.030991827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:28:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:28:03.030588376 +0000 UTC m=+846.680004469" watchObservedRunningTime="2026-09-15 09:28:03.030991827 +0000 UTC m=+846.680407917"
Sep 15 09:28:03.085336 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:03.085275    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch" podStartSLOduration=2.085252797 podStartE2EDuration="2.085252797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:28:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:28:03.083243737 +0000 UTC m=+846.732659831" watchObservedRunningTime="2026-09-15 09:28:03.085252797 +0000 UTC m=+846.734668889"
Sep 15 09:28:03.414561 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:03.414524    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:03.524079 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:03.524044    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:03.615251 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:03.615212    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:03.938460 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:03.938432    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:04.929501 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:04.929465    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:05.904385 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:05.904338    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:06.642015 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:06.641967    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:06.743575 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:06.743538    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:06.843050 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:06.843017    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:07.116284 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.116208    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:07.195004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.194973    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:07.225252 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.225219    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"]
Sep 15 09:28:07.229917 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.229889    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"
Sep 15 09:28:07.232099 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.232083    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-3b0480\""
Sep 15 09:28:07.232197 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.232148    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-3b0480-dockercfg-6kvpk\""
Sep 15 09:28:07.239668 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.239646    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"]
Sep 15 09:28:07.255594 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.255562    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"]
Sep 15 09:28:07.259419 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.259397    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"
Sep 15 09:28:07.268898 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.268874    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"]
Sep 15 09:28:07.306826 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.306788    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdcfd\" (UniqueName: \"kubernetes.io/projected/0947d3aa-2e22-4774-ac45-a3dd5e72d963-kube-api-access-sdcfd\") pod \"payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr\" (UID: \"0947d3aa-2e22-4774-ac45-a3dd5e72d963\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"
Sep 15 09:28:07.307025 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.306857    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27a09ae5-18dc-4e41-a58f-53ddc4341892-plugins-config-volume\") pod \"payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46\" (UID: \"27a09ae5-18dc-4e41-a58f-53ddc4341892\") " pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"
Sep 15 09:28:07.307025 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.306911    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqbjv\" (UniqueName: \"kubernetes.io/projected/27a09ae5-18dc-4e41-a58f-53ddc4341892-kube-api-access-pqbjv\") pod \"payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46\" (UID: \"27a09ae5-18dc-4e41-a58f-53ddc4341892\") " pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"
Sep 15 09:28:07.307025 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.306993    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0947d3aa-2e22-4774-ac45-a3dd5e72d963-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr\" (UID: \"0947d3aa-2e22-4774-ac45-a3dd5e72d963\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"
Sep 15 09:28:07.407674 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.407639    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqbjv\" (UniqueName: \"kubernetes.io/projected/27a09ae5-18dc-4e41-a58f-53ddc4341892-kube-api-access-pqbjv\") pod \"payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46\" (UID: \"27a09ae5-18dc-4e41-a58f-53ddc4341892\") " pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"
Sep 15 09:28:07.407870 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.407722    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0947d3aa-2e22-4774-ac45-a3dd5e72d963-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr\" (UID: \"0947d3aa-2e22-4774-ac45-a3dd5e72d963\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"
Sep 15 09:28:07.407870 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.407805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdcfd\" (UniqueName: \"kubernetes.io/projected/0947d3aa-2e22-4774-ac45-a3dd5e72d963-kube-api-access-sdcfd\") pod \"payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr\" (UID: \"0947d3aa-2e22-4774-ac45-a3dd5e72d963\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"
Sep 15 09:28:07.407870 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.407849    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27a09ae5-18dc-4e41-a58f-53ddc4341892-plugins-config-volume\") pod \"payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46\" (UID: \"27a09ae5-18dc-4e41-a58f-53ddc4341892\") " pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"
Sep 15 09:28:07.408487 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.408467    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0947d3aa-2e22-4774-ac45-a3dd5e72d963-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr\" (UID: \"0947d3aa-2e22-4774-ac45-a3dd5e72d963\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"
Sep 15 09:28:07.408536 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.408520    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27a09ae5-18dc-4e41-a58f-53ddc4341892-plugins-config-volume\") pod \"payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46\" (UID: \"27a09ae5-18dc-4e41-a58f-53ddc4341892\") " pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"
Sep 15 09:28:07.416085 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.416061    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdcfd\" (UniqueName: \"kubernetes.io/projected/0947d3aa-2e22-4774-ac45-a3dd5e72d963-kube-api-access-sdcfd\") pod \"payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr\" (UID: \"0947d3aa-2e22-4774-ac45-a3dd5e72d963\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"
Sep 15 09:28:07.416297 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.416274    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqbjv\" (UniqueName: \"kubernetes.io/projected/27a09ae5-18dc-4e41-a58f-53ddc4341892-kube-api-access-pqbjv\") pod \"payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46\" (UID: \"27a09ae5-18dc-4e41-a58f-53ddc4341892\") " pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"
Sep 15 09:28:07.542829 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.542755    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"
Sep 15 09:28:07.570822 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.570790    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"
Sep 15 09:28:07.648290 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.648038    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:07.744845 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.744742    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:07.821751 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.821725    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"]
Sep 15 09:28:07.823307 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:28:07.823277    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0947d3aa_2e22_4774_ac45_a3dd5e72d963.slice/crio-86a94bf4f1892ede8171c0beec2a58dd5ded90e4ade2b54aea7258da0637667d WatchSource:0}: Error finding container 86a94bf4f1892ede8171c0beec2a58dd5ded90e4ade2b54aea7258da0637667d: Status 404 returned error can't find the container with id 86a94bf4f1892ede8171c0beec2a58dd5ded90e4ade2b54aea7258da0637667d
Sep 15 09:28:07.868612 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.868589    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"]
Sep 15 09:28:07.870148 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:28:07.870125    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a09ae5_18dc_4e41_a58f_53ddc4341892.slice/crio-05e890e5ad51d0e6b43e554ed072690182cc6cc6e45fe358eb739ad42be69483 WatchSource:0}: Error finding container 05e890e5ad51d0e6b43e554ed072690182cc6cc6e45fe358eb739ad42be69483: Status 404 returned error can't find the container with id 05e890e5ad51d0e6b43e554ed072690182cc6cc6e45fe358eb739ad42be69483
Sep 15 09:28:07.961561 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:07.961528    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"
Sep 15 09:28:08.025324 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:08.025188    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46" event={"ID":"27a09ae5-18dc-4e41-a58f-53ddc4341892","Type":"ContainerStarted","Data":"4208d31ead6e668c571aed5d7a19f20baa35d80aedca99a2fb548e516790a7eb"}
Sep 15 09:28:08.025324 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:08.025258    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"
Sep 15 09:28:08.025324 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:08.025284    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46" event={"ID":"27a09ae5-18dc-4e41-a58f-53ddc4341892","Type":"ContainerStarted","Data":"05e890e5ad51d0e6b43e554ed072690182cc6cc6e45fe358eb739ad42be69483"}
Sep 15 09:28:08.026951 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:08.026927    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr" event={"ID":"0947d3aa-2e22-4774-ac45-a3dd5e72d963","Type":"ContainerStarted","Data":"1745e2c0dfbc7193208bc4156206ca459b983e7171a4584af4bc502bc6559645"}
Sep 15 09:28:08.026951 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:08.026963    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr" event={"ID":"0947d3aa-2e22-4774-ac45-a3dd5e72d963","Type":"ContainerStarted","Data":"86a94bf4f1892ede8171c0beec2a58dd5ded90e4ade2b54aea7258da0637667d"}
Sep 15 09:28:08.027154 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:08.027047    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"
Sep 15 09:28:08.045842 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:08.045531    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46" podStartSLOduration=1.045510463 podStartE2EDuration="1.045510463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:28:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:28:08.040954572 +0000 UTC m=+851.690370666" watchObservedRunningTime="2026-09-15 09:28:08.045510463 +0000 UTC m=+851.694926557"
Sep 15 09:28:08.056079 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:08.055945    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr" podStartSLOduration=1.055915692 podStartE2EDuration="1.055915692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:28:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:28:08.055328954 +0000 UTC m=+851.704745050" watchObservedRunningTime="2026-09-15 09:28:08.055915692 +0000 UTC m=+851.705331779"
Sep 15 09:28:08.129277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:08.129245    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:08.745431 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:08.745399    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:08.799454 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:08.799424    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:08.869169 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:08.869134    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:08.971481 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:08.971451    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"
Sep 15 09:28:09.109179 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:09.109099    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:09.298842 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:09.298810    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:09.395072 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:09.395042    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:09.465243 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:09.465212    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:09.643347 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:09.643310    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:09.743202 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:09.743110    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:10.171992 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:10.171963    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:10.330826 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:10.330791    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:10.427132 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:10.427045    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:10.527272 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:10.527237    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:10.628141 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:10.628104    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:10.982253 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:10.982217    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"
Sep 15 09:28:10.982443 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:10.982385    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"
Sep 15 09:28:11.388686 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:11.388645    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:12.345587 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:12.345552    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:12.446036 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:12.445993    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:12.546150 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:12.546104    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:12.807584 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:12.807549    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:13.224120 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:13.224081    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:13.369473 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:13.369432    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:13.470667 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:13.470609    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:13.641075 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:13.641022    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:14.002674 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:14.002604    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"
Sep 15 09:28:14.002674 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:14.002668    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"
Sep 15 09:28:14.673284 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:14.673235    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:14.753579 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:14.753521    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:14.854180 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:14.854151    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:15.192806 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.192777    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:15.292793 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.292730    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:15.296303 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.296279    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"]
Sep 15 09:28:15.301120 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.301098    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"
Sep 15 09:28:15.304675 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.304654    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-0e280a-dockercfg-xp8fv\""
Sep 15 09:28:15.304801 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.304654    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-0e280a\""
Sep 15 09:28:15.307143 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.307122    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"]
Sep 15 09:28:15.311106 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.311087    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"]
Sep 15 09:28:15.311204 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.311165    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"
Sep 15 09:28:15.322515 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.322495    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"]
Sep 15 09:28:15.391346 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.391317    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6a5c7c1-2435-4313-b46a-952d87859200-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x\" (UID: \"b6a5c7c1-2435-4313-b46a-952d87859200\") " pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"
Sep 15 09:28:15.391526 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.391359    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7fmz\" (UniqueName: \"kubernetes.io/projected/8cac8d3e-f163-4fe3-905c-0aec12be33d7-kube-api-access-h7fmz\") pod \"payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2\" (UID: \"8cac8d3e-f163-4fe3-905c-0aec12be33d7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"
Sep 15 09:28:15.391526 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.391495    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cac8d3e-f163-4fe3-905c-0aec12be33d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2\" (UID: \"8cac8d3e-f163-4fe3-905c-0aec12be33d7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"
Sep 15 09:28:15.391666 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.391536    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k7k4\" (UniqueName: \"kubernetes.io/projected/b6a5c7c1-2435-4313-b46a-952d87859200-kube-api-access-7k7k4\") pod \"payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x\" (UID: \"b6a5c7c1-2435-4313-b46a-952d87859200\") " pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"
Sep 15 09:28:15.492796 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.492681    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cac8d3e-f163-4fe3-905c-0aec12be33d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2\" (UID: \"8cac8d3e-f163-4fe3-905c-0aec12be33d7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"
Sep 15 09:28:15.492796 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.492741    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k7k4\" (UniqueName: \"kubernetes.io/projected/b6a5c7c1-2435-4313-b46a-952d87859200-kube-api-access-7k7k4\") pod \"payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x\" (UID: \"b6a5c7c1-2435-4313-b46a-952d87859200\") " pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"
Sep 15 09:28:15.493047 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.492810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6a5c7c1-2435-4313-b46a-952d87859200-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x\" (UID: \"b6a5c7c1-2435-4313-b46a-952d87859200\") " pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"
Sep 15 09:28:15.493047 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.492837    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7fmz\" (UniqueName: \"kubernetes.io/projected/8cac8d3e-f163-4fe3-905c-0aec12be33d7-kube-api-access-h7fmz\") pod \"payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2\" (UID: \"8cac8d3e-f163-4fe3-905c-0aec12be33d7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"
Sep 15 09:28:15.493469 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.493447    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cac8d3e-f163-4fe3-905c-0aec12be33d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2\" (UID: \"8cac8d3e-f163-4fe3-905c-0aec12be33d7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"
Sep 15 09:28:15.493508 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.493472    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6a5c7c1-2435-4313-b46a-952d87859200-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x\" (UID: \"b6a5c7c1-2435-4313-b46a-952d87859200\") " pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"
Sep 15 09:28:15.512430 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.509218    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7fmz\" (UniqueName: \"kubernetes.io/projected/8cac8d3e-f163-4fe3-905c-0aec12be33d7-kube-api-access-h7fmz\") pod \"payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2\" (UID: \"8cac8d3e-f163-4fe3-905c-0aec12be33d7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"
Sep 15 09:28:15.514708 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.514672    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k7k4\" (UniqueName: \"kubernetes.io/projected/b6a5c7c1-2435-4313-b46a-952d87859200-kube-api-access-7k7k4\") pod \"payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x\" (UID: \"b6a5c7c1-2435-4313-b46a-952d87859200\") " pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"
Sep 15 09:28:15.614201 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.614165    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"
Sep 15 09:28:15.624830 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.624798    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"
Sep 15 09:28:15.670220 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.670181    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:15.902515 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.902484    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"]
Sep 15 09:28:15.904108 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:28:15.904082    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cac8d3e_f163_4fe3_905c_0aec12be33d7.slice/crio-54878161f69558da674ffc2a9700729097c51a12b6904959437a438380df766d WatchSource:0}: Error finding container 54878161f69558da674ffc2a9700729097c51a12b6904959437a438380df766d: Status 404 returned error can't find the container with id 54878161f69558da674ffc2a9700729097c51a12b6904959437a438380df766d
Sep 15 09:28:15.920559 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:15.920531    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"]
Sep 15 09:28:15.924470 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:28:15.924446    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a5c7c1_2435_4313_b46a_952d87859200.slice/crio-1c4237618a914e5e839f27b7cd2b3d30dc458b00ffe484c818f4e77efe0bdcef WatchSource:0}: Error finding container 1c4237618a914e5e839f27b7cd2b3d30dc458b00ffe484c818f4e77efe0bdcef: Status 404 returned error can't find the container with id 1c4237618a914e5e839f27b7cd2b3d30dc458b00ffe484c818f4e77efe0bdcef
Sep 15 09:28:16.079144 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:16.078452    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2" event={"ID":"8cac8d3e-f163-4fe3-905c-0aec12be33d7","Type":"ContainerStarted","Data":"0684b6f519ecbd021b3f69572f9b01ac52ccf0219318e1747258e1a62d5b7f94"}
Sep 15 09:28:16.079144 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:16.078519    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2" event={"ID":"8cac8d3e-f163-4fe3-905c-0aec12be33d7","Type":"ContainerStarted","Data":"54878161f69558da674ffc2a9700729097c51a12b6904959437a438380df766d"}
Sep 15 09:28:16.079144 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:16.078835    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"
Sep 15 09:28:16.081167 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:16.081134    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x" event={"ID":"b6a5c7c1-2435-4313-b46a-952d87859200","Type":"ContainerStarted","Data":"ec4a17500187ce500ccf8d36e74029708fb117b44f50254eb3b2814ca92261d2"}
Sep 15 09:28:16.081320 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:16.081188    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x" event={"ID":"b6a5c7c1-2435-4313-b46a-952d87859200","Type":"ContainerStarted","Data":"1c4237618a914e5e839f27b7cd2b3d30dc458b00ffe484c818f4e77efe0bdcef"}
Sep 15 09:28:16.081320 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:16.081254    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"
Sep 15 09:28:16.098275 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:16.098230    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2" podStartSLOduration=1.098212834 podStartE2EDuration="1.098212834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:28:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:28:16.095822745 +0000 UTC m=+859.745238855" watchObservedRunningTime="2026-09-15 09:28:16.098212834 +0000 UTC m=+859.747628968"
Sep 15 09:28:16.114535 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:16.114049    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x" podStartSLOduration=1.114028107 podStartE2EDuration="1.114028107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:28:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:28:16.113826065 +0000 UTC m=+859.763242163" watchObservedRunningTime="2026-09-15 09:28:16.114028107 +0000 UTC m=+859.763444201"
Sep 15 09:28:16.275974 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:16.275866    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:17.334240 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:17.334212    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:17.548407 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:17.548372    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:18.559711 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:18.559670    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:19.034019 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:19.033995    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"
Sep 15 09:28:19.034262 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:19.034251    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"
Sep 15 09:28:19.347727 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:19.347604    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:20.338449 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:20.338406    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:21.240532 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:21.240502    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:22.030279 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:22.030239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:22.734733 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:22.734701    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:23.043330 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:23.043239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:23.425469 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:23.425432    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:24.229096 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:24.229060    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:24.975605 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:24.975572    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:25.142651 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:25.142600    2575 generic.go:356] "Generic (PLEG): container finished" podID="6afb041d-1884-4e0b-ac8c-8e14813068c2" containerID="0245bec65e56b0d31e0dced87398f5ecd5b8ebad5454b71bc81bfb4e37a5fe05" exitCode=0
Sep 15 09:28:25.142994 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:25.142676    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh" event={"ID":"6afb041d-1884-4e0b-ac8c-8e14813068c2","Type":"ContainerDied","Data":"0245bec65e56b0d31e0dced87398f5ecd5b8ebad5454b71bc81bfb4e37a5fe05"}
Sep 15 09:28:25.143289 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:25.143272    2575 scope.go:117] "RemoveContainer" containerID="0245bec65e56b0d31e0dced87398f5ecd5b8ebad5454b71bc81bfb4e37a5fe05"
Sep 15 09:28:25.144710 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:25.144674    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:28:25.144797 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:25.144779    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:28:25.144869 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:25.144853    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:28:25.832197 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:25.832158    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:26.154032 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:26.153992    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh" event={"ID":"6afb041d-1884-4e0b-ac8c-8e14813068c2","Type":"ContainerStarted","Data":"782a9b77ca7e62a1bc095c9990aad652b335d4cff708f451905f36d8dcb36767"}
Sep 15 09:28:26.564985 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:26.564892    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:26.784942 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:26.784904    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:28:26.786112 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:26.786087    2575 patch_prober.go:28] interesting pod/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 15 09:28:26.786212 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:26.786148    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh" podUID="6afb041d-1884-4e0b-ac8c-8e14813068c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 15 09:28:26.954640 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:26.954597    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:28:27.080866 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:27.080829    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:27.089542 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:27.089502    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"
Sep 15 09:28:27.090025 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:27.090005    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"
Sep 15 09:28:27.411424 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:27.411398    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:27.785193 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:27.785111    2575 patch_prober.go:28] interesting pod/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 15 09:28:27.785345 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:27.785181    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh" podUID="6afb041d-1884-4e0b-ac8c-8e14813068c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 15 09:28:28.463475 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:28.463442    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:28.784736 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:28.784642    2575 patch_prober.go:28] interesting pod/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 15 09:28:28.784736 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:28.784700    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh" podUID="6afb041d-1884-4e0b-ac8c-8e14813068c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 15 09:28:29.204594 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:29.204556    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:29.785313 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:29.785275    2575 patch_prober.go:28] interesting pod/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 15 09:28:29.785677 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:29.785335    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh" podUID="6afb041d-1884-4e0b-ac8c-8e14813068c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 15 09:28:30.158637 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:30.158606    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:30.785159 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:30.785125    2575 patch_prober.go:28] interesting pod/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 15 09:28:30.785342 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:30.785179    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh" podUID="6afb041d-1884-4e0b-ac8c-8e14813068c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 15 09:28:31.018298 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:31.018244    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:31.338657 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:31.338618    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:31.461533 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:31.461495    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:31.570837 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:31.570803    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:31.803303 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:31.803271    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:28:31.805379 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:31.805353    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:28:31.865922 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:31.865874    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:32.730930 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:32.730894    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:33.426677 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:33.426640    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:35.565899 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:35.565868    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:37.153296 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:37.153255    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:37.211335 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:37.211305    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:37.294601 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:37.294564    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:37.401270 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:37.401238    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:37.538963 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:37.538878    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:43.189705 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:43.189672    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:43.248558 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:43.248527    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:44.143569 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:44.143523    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:44.709748 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:44.709716    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:44.783641 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:44.783604    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:44.840589 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:44.840562    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:44.950082 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:44.950051    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:45.045057 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:45.044972    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:45.110403 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:45.110375    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:45.430104 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:45.430067    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:45.531895 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:45.531863    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:45.632194 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:45.632163    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:45.739287 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:45.739210    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:46.012739 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:46.012658    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:46.260535 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:46.260507    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:46.361373 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:46.361290    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:47.145258 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:47.145226    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:47.826567 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:47.826473    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:48.519448 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:48.519410    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:49.040475 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:49.040446    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:49.142322 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:49.142278    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:49.414991 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:49.414953    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:50.133043 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:50.133014    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:50.233639 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:50.233609    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:50.287754 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:50.287707    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:50.598729 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:50.598700    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:50.681850 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:50.681795    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:51.138064 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:51.138036    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:51.915105 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:51.915071    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:53.106338 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:53.106311    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:53.426478 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:53.426438    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:54.078646 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:54.078619    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:28:56.827381 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:56.827353    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:28:56.831504 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:56.831480    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:28:56.833321 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:56.833303    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:28:56.840711 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:28:56.840694    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:29:12.228945 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:12.228905    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:12.900124 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:12.900088    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:13.561586 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:13.561548    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:14.350271 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:14.350242    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:15.137262 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:15.137229    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:15.774426 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:15.774395    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:16.519483 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:16.519442    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:17.433270 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:17.433239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:18.092465 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:18.092432    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:18.828912 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:18.828883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:20.130966 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:20.130932    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:20.731854 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:20.731818    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:20.852327 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:20.852293    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:20.911830 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:20.911798    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:20.979466 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:20.979437    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:21.798809 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:21.798776    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:21.889747 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:21.889718    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:22.051868 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:22.051787    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:22.296777 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:22.296733    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:22.733610 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:22.733573    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:23.514476 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:23.514443    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:24.165480 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:24.165446    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:24.256196 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:24.256158    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:25.145371 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:25.145338    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:25.835547 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:25.835514    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:25.936562 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:25.936524    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:26.038949 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:26.038918    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:26.299404 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:26.299369    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:26.382407 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:26.382371    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:26.705314 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:26.705281    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:27.532951 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:27.532920    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:28.222889 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:28.222860    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:28.886466 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:28.886430    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:33.096721 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:33.096694    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:36.875194 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:36.875160    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:36.962421 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:36.962330    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:43.940402 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:43.940372    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:47.847158 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:47.847118    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:48.980511 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:48.980476    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:49.255154 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:49.255057    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:49.922777 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:49.922737    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:50.823456 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:50.823425    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:51.563185 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:51.563150    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:52.282294 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:52.282254    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:53.039965 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:53.039937    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:53.681443 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:53.681411    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:54.352176 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:54.352142    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:55.012879 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:55.012844    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:55.571989 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:55.571957    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:55.641445 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:55.641353    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:55.695031 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:55.695002    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:55.763715 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:55.763682    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:55.826718 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:55.826646    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:56.229898 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:56.229866    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:56.918117 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:56.918085    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:57.018603 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:57.018574    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:57.387882 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:57.387846    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:57.683413 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:57.683344    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:57.785176 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:57.785141    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:58.485757 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:58.485727    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:58.586406 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:58.586377    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:29:59.130622 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:29:59.130589    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:00.024396 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.024366    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:00.151737 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.151703    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e76bac-29824410-z6l44"]
Sep 15 09:30:00.155423 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.155401    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c183a5-29824410-gzzcg"]
Sep 15 09:30:00.155566 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.155516    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e76bac-29824410-z6l44"
Sep 15 09:30:00.158032 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.158012    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:30:00.158972 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.158955    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c183a5-29824410-gzzcg"
Sep 15 09:30:00.166923 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.166895    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e76bac-29824410-z6l44"]
Sep 15 09:30:00.168687 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.168664    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e76bac-29824410-z6l44"
Sep 15 09:30:00.170026 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.169994    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c183a5-29824410-gzzcg"]
Sep 15 09:30:00.172822 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.172799    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-0e280a-29824410-zmrfh"]
Sep 15 09:30:00.179468 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.179450    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c183a5-29824410-gzzcg"
Sep 15 09:30:00.182154 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.182132    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-0e280a-29824410-zmrfh"
Sep 15 09:30:00.182566 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.182548    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-0e280a-29824410-zmrfh"]
Sep 15 09:30:00.221843 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.221821    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-0e280a-29824410-zmrfh"
Sep 15 09:30:00.445372 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.445338    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:00.468530 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.468511    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e76bac-29824410-z6l44"]
Sep 15 09:30:00.470947 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:30:00.470921    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e05da4_889e_49a1_9bc5_9d72c7e344d4.slice/crio-b85b09d86a9e80f0af852ddd1d294fd61ad066a10c1bb30b123c929afe7c6c75 WatchSource:0}: Error finding container b85b09d86a9e80f0af852ddd1d294fd61ad066a10c1bb30b123c929afe7c6c75: Status 404 returned error can't find the container with id b85b09d86a9e80f0af852ddd1d294fd61ad066a10c1bb30b123c929afe7c6c75
Sep 15 09:30:00.474728 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.474705    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c183a5-29824410-gzzcg"]
Sep 15 09:30:00.476320 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:30:00.476292    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec6627e3_3844_44a0_bbf5_135d7173512b.slice/crio-a640cbab886991bbb866880bdbe308a0276ec2b2a8ba3d840414b8231b933d51 WatchSource:0}: Error finding container a640cbab886991bbb866880bdbe308a0276ec2b2a8ba3d840414b8231b933d51: Status 404 returned error can't find the container with id a640cbab886991bbb866880bdbe308a0276ec2b2a8ba3d840414b8231b933d51
Sep 15 09:30:00.522183 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.522156    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-0e280a-29824410-zmrfh"]
Sep 15 09:30:00.523466 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:30:00.523441    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3282a614_4c2a_42fd_972f_d988af61d208.slice/crio-6855dc1df97503d636c3220192b3b4e06fe88623e45c7f7ba04b0e14b16559fe WatchSource:0}: Error finding container 6855dc1df97503d636c3220192b3b4e06fe88623e45c7f7ba04b0e14b16559fe: Status 404 returned error can't find the container with id 6855dc1df97503d636c3220192b3b4e06fe88623e45c7f7ba04b0e14b16559fe
Sep 15 09:30:00.544940 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.544853    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:00.680076 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.680042    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c183a5-29824410-gzzcg" event={"ID":"ec6627e3-3844-44a0-bbf5-135d7173512b","Type":"ContainerStarted","Data":"a640cbab886991bbb866880bdbe308a0276ec2b2a8ba3d840414b8231b933d51"}
Sep 15 09:30:00.681417 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.681391    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-0e280a-29824410-zmrfh" event={"ID":"3282a614-4c2a-42fd-972f-d988af61d208","Type":"ContainerStarted","Data":"6855dc1df97503d636c3220192b3b4e06fe88623e45c7f7ba04b0e14b16559fe"}
Sep 15 09:30:00.682677 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.682658    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e76bac-29824410-z6l44" event={"ID":"a7e05da4-889e-49a1-9bc5-9d72c7e344d4","Type":"ContainerStarted","Data":"b85b09d86a9e80f0af852ddd1d294fd61ad066a10c1bb30b123c929afe7c6c75"}
Sep 15 09:30:00.889475 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:00.889448    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:01.862413 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:01.862373    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:02.558243 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:02.558214    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:03.502437 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:03.502402    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:03.705337 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:03.705300    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c183a5-29824410-gzzcg" event={"ID":"ec6627e3-3844-44a0-bbf5-135d7173512b","Type":"ContainerStarted","Data":"3ff76cd1bb8023204eb3adb7ce02f5cd0d66da13ea304147552c5e47af5f8250"}
Sep 15 09:30:03.706969 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:03.706942    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-0e280a-29824410-zmrfh" event={"ID":"3282a614-4c2a-42fd-972f-d988af61d208","Type":"ContainerStarted","Data":"91ce7567ac8dbbdfb35458d499becbf16e31f2284e312835bcca9ca007596cbf"}
Sep 15 09:30:03.708464 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:03.708435    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e76bac-29824410-z6l44" event={"ID":"a7e05da4-889e-49a1-9bc5-9d72c7e344d4","Type":"ContainerStarted","Data":"ad6fd1757636651d917904298e7e152d151c676f82de5daa19dba3444b21b897"}
Sep 15 09:30:03.718586 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:03.718509    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c183a5-29824410-gzzcg" podStartSLOduration=0.965302333 podStartE2EDuration="3.718494849s" totalImagesPullingTime="2.753192516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:30:03.717969261 +0000 UTC m=+967.367385354" watchObservedRunningTime="2026-09-15 09:30:03.718494849 +0000 UTC m=+967.367910983"
Sep 15 09:30:03.731619 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:03.731572    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e76bac-29824410-z6l44" podStartSLOduration=0.973182599 podStartE2EDuration="3.731559072s" totalImagesPullingTime="2.758376473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:30:03.729962928 +0000 UTC m=+967.379379023" watchObservedRunningTime="2026-09-15 09:30:03.731559072 +0000 UTC m=+967.380975165"
Sep 15 09:30:03.744784 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:03.744703    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-0e280a-29824410-zmrfh" podStartSLOduration=1.034208313 podStartE2EDuration="3.744685209s" totalImagesPullingTime="2.710476896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:30:03.742002842 +0000 UTC m=+967.391418936" watchObservedRunningTime="2026-09-15 09:30:03.744685209 +0000 UTC m=+967.394101303"
Sep 15 09:30:04.306743 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:04.306706    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:04.551634 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:04.551601    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:04.715870 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:04.715829    2575 generic.go:356] "Generic (PLEG): container finished" podID="ec6627e3-3844-44a0-bbf5-135d7173512b" containerID="3ff76cd1bb8023204eb3adb7ce02f5cd0d66da13ea304147552c5e47af5f8250" exitCode=0
Sep 15 09:30:04.716063 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:04.715911    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c183a5-29824410-gzzcg" event={"ID":"ec6627e3-3844-44a0-bbf5-135d7173512b","Type":"ContainerDied","Data":"3ff76cd1bb8023204eb3adb7ce02f5cd0d66da13ea304147552c5e47af5f8250"}
Sep 15 09:30:04.717522 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:04.717500    2575 generic.go:356] "Generic (PLEG): container finished" podID="3282a614-4c2a-42fd-972f-d988af61d208" containerID="91ce7567ac8dbbdfb35458d499becbf16e31f2284e312835bcca9ca007596cbf" exitCode=0
Sep 15 09:30:04.717657 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:04.717576    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-0e280a-29824410-zmrfh" event={"ID":"3282a614-4c2a-42fd-972f-d988af61d208","Type":"ContainerDied","Data":"91ce7567ac8dbbdfb35458d499becbf16e31f2284e312835bcca9ca007596cbf"}
Sep 15 09:30:04.719168 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:04.719151    2575 generic.go:356] "Generic (PLEG): container finished" podID="a7e05da4-889e-49a1-9bc5-9d72c7e344d4" containerID="ad6fd1757636651d917904298e7e152d151c676f82de5daa19dba3444b21b897" exitCode=0
Sep 15 09:30:04.719273 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:04.719187    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e76bac-29824410-z6l44" event={"ID":"a7e05da4-889e-49a1-9bc5-9d72c7e344d4","Type":"ContainerDied","Data":"ad6fd1757636651d917904298e7e152d151c676f82de5daa19dba3444b21b897"}
Sep 15 09:30:05.201385 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:05.201357    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:05.301898 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:05.301868    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:05.670423 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:05.670395    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:05.766458 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:05.766410    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:05.955784 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:05.955397    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e76bac-29824410-z6l44"
Sep 15 09:30:05.958205 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:05.958184    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-0e280a-29824410-zmrfh"
Sep 15 09:30:05.961559 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:05.961541    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c183a5-29824410-gzzcg"
Sep 15 09:30:06.732017 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:06.731987    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e76bac-29824410-z6l44"
Sep 15 09:30:06.732017 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:06.732010    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e76bac-29824410-z6l44" event={"ID":"a7e05da4-889e-49a1-9bc5-9d72c7e344d4","Type":"ContainerDied","Data":"b85b09d86a9e80f0af852ddd1d294fd61ad066a10c1bb30b123c929afe7c6c75"}
Sep 15 09:30:06.732548 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:06.732051    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b85b09d86a9e80f0af852ddd1d294fd61ad066a10c1bb30b123c929afe7c6c75"
Sep 15 09:30:06.733299 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:06.733283    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c183a5-29824410-gzzcg"
Sep 15 09:30:06.733419 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:06.733338    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c183a5-29824410-gzzcg" event={"ID":"ec6627e3-3844-44a0-bbf5-135d7173512b","Type":"ContainerDied","Data":"a640cbab886991bbb866880bdbe308a0276ec2b2a8ba3d840414b8231b933d51"}
Sep 15 09:30:06.733419 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:06.733382    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a640cbab886991bbb866880bdbe308a0276ec2b2a8ba3d840414b8231b933d51"
Sep 15 09:30:06.734746 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:06.734727    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-0e280a-29824410-zmrfh" event={"ID":"3282a614-4c2a-42fd-972f-d988af61d208","Type":"ContainerDied","Data":"6855dc1df97503d636c3220192b3b4e06fe88623e45c7f7ba04b0e14b16559fe"}
Sep 15 09:30:06.734851 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:06.734748    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-0e280a-29824410-zmrfh"
Sep 15 09:30:06.734851 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:06.734788    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6855dc1df97503d636c3220192b3b4e06fe88623e45c7f7ba04b0e14b16559fe"
Sep 15 09:30:18.595608 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:18.595518    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:25.201261 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:25.201228    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:26.056049 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:26.056004    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:27.407999 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:27.407969    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:28.245617 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:28.245574    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:29.078532 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:29.078496    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:29.449405 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:29.449361    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:30.221526 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:30.221487    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:31.116912 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:31.116872    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:31.218092 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:31.218042    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:31.761216 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:31.761172    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:32.526674 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:32.526634    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:33.190248 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:33.190193    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:33.846543 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:33.846512    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:34.752950 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:34.752915    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:35.438333 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:35.438293    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:35.536485 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:35.536443    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:41.920364 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:41.920322    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:42.486614 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:42.486581    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:42.561277 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:42.561245    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:42.619898 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:42.619865    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:42.686438 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:42.686397    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:42.746864 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:42.746749    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:42.828308 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:42.828281    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:43.100701 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:43.100618    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:43.496579 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:43.496543    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:43.565427 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:43.565396    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:43.666031 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:43.666003    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:43.898364 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:43.898326    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:44.897884 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:44.897846    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:45.002975 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:45.002940    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:45.840911 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:45.840863    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:46.212548 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:46.212519    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:46.955940 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:46.955902    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:50.663393 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:50.663361    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:50.767369 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:50.767338    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:50.863632 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:50.863606    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:50.963826 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:50.963743    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:51.771973 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:51.771939    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:57.121898 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:57.121871    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:57.610404 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:57.610363    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:58.330045 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:58.330001    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:59.129067 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:59.129034    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:30:59.820119 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:30:59.820084    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:00.627040 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:00.627004    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:01.386554 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:01.386523    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:02.224809 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:02.224779    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:07.749294 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:07.749257    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:07.769068 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:07.769038    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"]
Sep 15 09:31:07.769314 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:07.769269    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46" podUID="27a09ae5-18dc-4e41-a58f-53ddc4341892" containerName="payload-processing" containerID="cri-o://4208d31ead6e668c571aed5d7a19f20baa35d80aedca99a2fb548e516790a7eb" gracePeriod=30
Sep 15 09:31:07.773519 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:07.773436    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"]
Sep 15 09:31:07.773812 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:07.773646    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr" podUID="0947d3aa-2e22-4774-ac45-a3dd5e72d963" containerName="payload-pre-processing" containerID="cri-o://1745e2c0dfbc7193208bc4156206ca459b983e7171a4584af4bc502bc6559645" gracePeriod=30
Sep 15 09:31:07.813153 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:07.813127    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:07.866899 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:07.866869    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:07.937383 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:07.937352    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:07.988717 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:07.988693    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:08.070727 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.070701    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"
Sep 15 09:31:08.073777 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.073730    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"
Sep 15 09:31:08.081808 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.081787    2575 generic.go:356] "Generic (PLEG): container finished" podID="0947d3aa-2e22-4774-ac45-a3dd5e72d963" containerID="1745e2c0dfbc7193208bc4156206ca459b983e7171a4584af4bc502bc6559645" exitCode=0
Sep 15 09:31:08.081971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.081868    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr" event={"ID":"0947d3aa-2e22-4774-ac45-a3dd5e72d963","Type":"ContainerDied","Data":"1745e2c0dfbc7193208bc4156206ca459b983e7171a4584af4bc502bc6559645"}
Sep 15 09:31:08.081971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.081891    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"
Sep 15 09:31:08.081971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.081929    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr" event={"ID":"0947d3aa-2e22-4774-ac45-a3dd5e72d963","Type":"ContainerDied","Data":"86a94bf4f1892ede8171c0beec2a58dd5ded90e4ade2b54aea7258da0637667d"}
Sep 15 09:31:08.081971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.081957    2575 scope.go:117] "RemoveContainer" containerID="1745e2c0dfbc7193208bc4156206ca459b983e7171a4584af4bc502bc6559645"
Sep 15 09:31:08.083294 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.083272    2575 generic.go:356] "Generic (PLEG): container finished" podID="27a09ae5-18dc-4e41-a58f-53ddc4341892" containerID="4208d31ead6e668c571aed5d7a19f20baa35d80aedca99a2fb548e516790a7eb" exitCode=0
Sep 15 09:31:08.083393 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.083311    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"
Sep 15 09:31:08.083393 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.083358    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46" event={"ID":"27a09ae5-18dc-4e41-a58f-53ddc4341892","Type":"ContainerDied","Data":"4208d31ead6e668c571aed5d7a19f20baa35d80aedca99a2fb548e516790a7eb"}
Sep 15 09:31:08.083476 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.083412    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46" event={"ID":"27a09ae5-18dc-4e41-a58f-53ddc4341892","Type":"ContainerDied","Data":"05e890e5ad51d0e6b43e554ed072690182cc6cc6e45fe358eb739ad42be69483"}
Sep 15 09:31:08.092310 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.092289    2575 scope.go:117] "RemoveContainer" containerID="1745e2c0dfbc7193208bc4156206ca459b983e7171a4584af4bc502bc6559645"
Sep 15 09:31:08.092673 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:31:08.092648    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1745e2c0dfbc7193208bc4156206ca459b983e7171a4584af4bc502bc6559645\": container with ID starting with 1745e2c0dfbc7193208bc4156206ca459b983e7171a4584af4bc502bc6559645 not found: ID does not exist" containerID="1745e2c0dfbc7193208bc4156206ca459b983e7171a4584af4bc502bc6559645"
Sep 15 09:31:08.092792 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.092682    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1745e2c0dfbc7193208bc4156206ca459b983e7171a4584af4bc502bc6559645"} err="failed to get container status \"1745e2c0dfbc7193208bc4156206ca459b983e7171a4584af4bc502bc6559645\": rpc error: code = NotFound desc = could not find container \"1745e2c0dfbc7193208bc4156206ca459b983e7171a4584af4bc502bc6559645\": container with ID starting with 1745e2c0dfbc7193208bc4156206ca459b983e7171a4584af4bc502bc6559645 not found: ID does not exist"
Sep 15 09:31:08.092792 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.092704    2575 scope.go:117] "RemoveContainer" containerID="4208d31ead6e668c571aed5d7a19f20baa35d80aedca99a2fb548e516790a7eb"
Sep 15 09:31:08.101113 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.101097    2575 scope.go:117] "RemoveContainer" containerID="4208d31ead6e668c571aed5d7a19f20baa35d80aedca99a2fb548e516790a7eb"
Sep 15 09:31:08.101384 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:31:08.101365    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4208d31ead6e668c571aed5d7a19f20baa35d80aedca99a2fb548e516790a7eb\": container with ID starting with 4208d31ead6e668c571aed5d7a19f20baa35d80aedca99a2fb548e516790a7eb not found: ID does not exist" containerID="4208d31ead6e668c571aed5d7a19f20baa35d80aedca99a2fb548e516790a7eb"
Sep 15 09:31:08.101447 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.101390    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4208d31ead6e668c571aed5d7a19f20baa35d80aedca99a2fb548e516790a7eb"} err="failed to get container status \"4208d31ead6e668c571aed5d7a19f20baa35d80aedca99a2fb548e516790a7eb\": rpc error: code = NotFound desc = could not find container \"4208d31ead6e668c571aed5d7a19f20baa35d80aedca99a2fb548e516790a7eb\": container with ID starting with 4208d31ead6e668c571aed5d7a19f20baa35d80aedca99a2fb548e516790a7eb not found: ID does not exist"
Sep 15 09:31:08.203244 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.203214    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27a09ae5-18dc-4e41-a58f-53ddc4341892-plugins-config-volume\") pod \"27a09ae5-18dc-4e41-a58f-53ddc4341892\" (UID: \"27a09ae5-18dc-4e41-a58f-53ddc4341892\") "
Sep 15 09:31:08.203439 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.203259    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqbjv\" (UniqueName: \"kubernetes.io/projected/27a09ae5-18dc-4e41-a58f-53ddc4341892-kube-api-access-pqbjv\") pod \"27a09ae5-18dc-4e41-a58f-53ddc4341892\" (UID: \"27a09ae5-18dc-4e41-a58f-53ddc4341892\") "
Sep 15 09:31:08.203439 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.203309    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdcfd\" (UniqueName: \"kubernetes.io/projected/0947d3aa-2e22-4774-ac45-a3dd5e72d963-kube-api-access-sdcfd\") pod \"0947d3aa-2e22-4774-ac45-a3dd5e72d963\" (UID: \"0947d3aa-2e22-4774-ac45-a3dd5e72d963\") "
Sep 15 09:31:08.203439 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.203333    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0947d3aa-2e22-4774-ac45-a3dd5e72d963-plugins-config-volume\") pod \"0947d3aa-2e22-4774-ac45-a3dd5e72d963\" (UID: \"0947d3aa-2e22-4774-ac45-a3dd5e72d963\") "
Sep 15 09:31:08.203741 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.203708    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27a09ae5-18dc-4e41-a58f-53ddc4341892-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "27a09ae5-18dc-4e41-a58f-53ddc4341892" (UID: "27a09ae5-18dc-4e41-a58f-53ddc4341892"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:31:08.203895 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.203738    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0947d3aa-2e22-4774-ac45-a3dd5e72d963-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0947d3aa-2e22-4774-ac45-a3dd5e72d963" (UID: "0947d3aa-2e22-4774-ac45-a3dd5e72d963"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:31:08.205552 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.205529    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0947d3aa-2e22-4774-ac45-a3dd5e72d963-kube-api-access-sdcfd" (OuterVolumeSpecName: "kube-api-access-sdcfd") pod "0947d3aa-2e22-4774-ac45-a3dd5e72d963" (UID: "0947d3aa-2e22-4774-ac45-a3dd5e72d963"). InnerVolumeSpecName "kube-api-access-sdcfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:31:08.205636 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.205619    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27a09ae5-18dc-4e41-a58f-53ddc4341892-kube-api-access-pqbjv" (OuterVolumeSpecName: "kube-api-access-pqbjv") pod "27a09ae5-18dc-4e41-a58f-53ddc4341892" (UID: "27a09ae5-18dc-4e41-a58f-53ddc4341892"). InnerVolumeSpecName "kube-api-access-pqbjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:31:08.304576 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.304502    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27a09ae5-18dc-4e41-a58f-53ddc4341892-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:31:08.304576 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.304528    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqbjv\" (UniqueName: \"kubernetes.io/projected/27a09ae5-18dc-4e41-a58f-53ddc4341892-kube-api-access-pqbjv\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:31:08.304576 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.304537    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdcfd\" (UniqueName: \"kubernetes.io/projected/0947d3aa-2e22-4774-ac45-a3dd5e72d963-kube-api-access-sdcfd\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:31:08.304576 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.304548    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0947d3aa-2e22-4774-ac45-a3dd5e72d963-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:31:08.325081 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.325050    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:08.408684 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.408654    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"]
Sep 15 09:31:08.411003 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.410979    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:08.412364 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.412346    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3b0480-5f79856bf5-hvs46"]
Sep 15 09:31:08.421523 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.421498    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"]
Sep 15 09:31:08.424672 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.424652    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3b0480-5456bf45c8-w67xr"]
Sep 15 09:31:08.858997 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.858965    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0947d3aa-2e22-4774-ac45-a3dd5e72d963" path="/var/lib/kubelet/pods/0947d3aa-2e22-4774-ac45-a3dd5e72d963/volumes"
Sep 15 09:31:08.859351 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:08.859341    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27a09ae5-18dc-4e41-a58f-53ddc4341892" path="/var/lib/kubelet/pods/27a09ae5-18dc-4e41-a58f-53ddc4341892/volumes"
Sep 15 09:31:09.033433 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:09.033399    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:09.829007 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:09.828969    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:10.499748 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:10.499717    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:11.335039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:11.335010    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:14.091790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:14.091728    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:14.143150 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:14.143120    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:14.344987 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:14.344885    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:14.792920 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:14.792864    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:15.095029 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:15.094951    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:15.883051 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:15.883014    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:17.208555 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:17.208527    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:17.828899 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:17.828858    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:18.322901 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:18.322873    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:18.512986 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:18.512956    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:18.603633 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:18.603558    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:19.560812 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:19.560736    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:20.272489 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:20.272458    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:21.028016 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:21.027985    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:21.867558 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:21.867523    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:21.923989 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:21.923952    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:22.024940 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:22.024907    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:22.385855 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:22.385824    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:22.470551 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:22.470502    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:23.467414 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:23.467375    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:23.574494 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:23.574458    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:23.678131 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:23.678103    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:39.499145 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:39.499114    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:43.397427 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:43.397398    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:43.793991 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:43.793925    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:44.729179 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:44.729143    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:45.312577 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:45.312543    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:45.419314 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:45.419282    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:45.513054 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:45.513019    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:45.700039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:45.700012    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:47.296980 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:47.296941    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:47.351104 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:47.351067    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:47.856272 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:47.856187    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:55.976288 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:55.976257    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:31:56.744242 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:31:56.744205    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:02.666152 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:02.666117    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:02.774579 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:02.774541    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:02.866167 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:02.866131    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:03.023501 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:03.023414    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:03.538925 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:03.538894    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:03.637348 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:03.637306    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:03.742778 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:03.742742    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:06.308037 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:06.308009    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:10.919587 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:10.919550    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:11.018606 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:11.018570    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:12.403351 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:12.403319    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:16.687872 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:16.687837    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:17.416537 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:17.416501    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:17.475075 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:17.475039    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:17.634118 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:17.634091    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:17.936992 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:17.936959    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:18.200964 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:18.200884    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:22.823163 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:22.823127    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:23.423313 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:23.423287    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:23.520215 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:23.520181    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:24.243527 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:24.243487    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:24.370459 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:24.370419    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:25.244577 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:25.244543    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:25.899229 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:25.899179    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:26.536887 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:26.536854    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:27.389181 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:27.389147    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:27.484950 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:27.484918    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:27.586049 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:27.586016    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:27.888965 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:27.888939    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:28.022380 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.022345    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"]
Sep 15 09:32:28.022872 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.022855    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a09ae5-18dc-4e41-a58f-53ddc4341892" containerName="payload-processing"
Sep 15 09:32:28.022872 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.022875    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a09ae5-18dc-4e41-a58f-53ddc4341892" containerName="payload-processing"
Sep 15 09:32:28.023040 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.022892    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3282a614-4c2a-42fd-972f-d988af61d208" containerName="cleanup"
Sep 15 09:32:28.023040 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.022900    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3282a614-4c2a-42fd-972f-d988af61d208" containerName="cleanup"
Sep 15 09:32:28.023040 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.022927    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0947d3aa-2e22-4774-ac45-a3dd5e72d963" containerName="payload-pre-processing"
Sep 15 09:32:28.023040 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.022937    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0947d3aa-2e22-4774-ac45-a3dd5e72d963" containerName="payload-pre-processing"
Sep 15 09:32:28.023040 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.022947    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec6627e3-3844-44a0-bbf5-135d7173512b" containerName="cleanup"
Sep 15 09:32:28.023040 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.022955    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec6627e3-3844-44a0-bbf5-135d7173512b" containerName="cleanup"
Sep 15 09:32:28.023040 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.022973    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e05da4-889e-49a1-9bc5-9d72c7e344d4" containerName="cleanup"
Sep 15 09:32:28.023040 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.022980    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e05da4-889e-49a1-9bc5-9d72c7e344d4" containerName="cleanup"
Sep 15 09:32:28.023430 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.023081    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3282a614-4c2a-42fd-972f-d988af61d208" containerName="cleanup"
Sep 15 09:32:28.023430 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.023097    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a09ae5-18dc-4e41-a58f-53ddc4341892" containerName="payload-processing"
Sep 15 09:32:28.023430 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.023106    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0947d3aa-2e22-4774-ac45-a3dd5e72d963" containerName="payload-pre-processing"
Sep 15 09:32:28.023430 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.023118    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec6627e3-3844-44a0-bbf5-135d7173512b" containerName="cleanup"
Sep 15 09:32:28.023430 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.023129    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7e05da4-889e-49a1-9bc5-9d72c7e344d4" containerName="cleanup"
Sep 15 09:32:28.026419 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.026399    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"
Sep 15 09:32:28.028665 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.028644    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-8df9f24a\""
Sep 15 09:32:28.028778 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.028681    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-8df9f24a-dockercfg-cbgm4\""
Sep 15 09:32:28.036018 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.035997    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"]
Sep 15 09:32:28.040290 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.040264    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:28.121051 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.121018    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdde323a-d12b-418e-9edb-964972309599-plugins-config-volume\") pod \"payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb\" (UID: \"bdde323a-d12b-418e-9edb-964972309599\") " pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"
Sep 15 09:32:28.121219 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.121062    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzm5m\" (UniqueName: \"kubernetes.io/projected/bdde323a-d12b-418e-9edb-964972309599-kube-api-access-lzm5m\") pod \"payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb\" (UID: \"bdde323a-d12b-418e-9edb-964972309599\") " pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"
Sep 15 09:32:28.222586 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.222495    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdde323a-d12b-418e-9edb-964972309599-plugins-config-volume\") pod \"payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb\" (UID: \"bdde323a-d12b-418e-9edb-964972309599\") " pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"
Sep 15 09:32:28.222586 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.222542    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzm5m\" (UniqueName: \"kubernetes.io/projected/bdde323a-d12b-418e-9edb-964972309599-kube-api-access-lzm5m\") pod \"payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb\" (UID: \"bdde323a-d12b-418e-9edb-964972309599\") " pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"
Sep 15 09:32:28.223217 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.223196    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdde323a-d12b-418e-9edb-964972309599-plugins-config-volume\") pod \"payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb\" (UID: \"bdde323a-d12b-418e-9edb-964972309599\") " pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"
Sep 15 09:32:28.230287 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.230262    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzm5m\" (UniqueName: \"kubernetes.io/projected/bdde323a-d12b-418e-9edb-964972309599-kube-api-access-lzm5m\") pod \"payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb\" (UID: \"bdde323a-d12b-418e-9edb-964972309599\") " pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"
Sep 15 09:32:28.338114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.338081    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"
Sep 15 09:32:28.613855 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:28.613828    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"]
Sep 15 09:32:28.616037 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:32:28.616005    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdde323a_d12b_418e_9edb_964972309599.slice/crio-25739b2930d20dbcf11e4d531d66336c4dd966c5e59dbb1dd032525e786d657e WatchSource:0}: Error finding container 25739b2930d20dbcf11e4d531d66336c4dd966c5e59dbb1dd032525e786d657e: Status 404 returned error can't find the container with id 25739b2930d20dbcf11e4d531d66336c4dd966c5e59dbb1dd032525e786d657e
Sep 15 09:32:29.546091 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:29.546038    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb" event={"ID":"bdde323a-d12b-418e-9edb-964972309599","Type":"ContainerStarted","Data":"efc3a7fa379fa1577bd3a3c80fe816155591d5a8ba05d55b412de583a5cd92f5"}
Sep 15 09:32:29.546297 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:29.546115    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb" event={"ID":"bdde323a-d12b-418e-9edb-964972309599","Type":"ContainerStarted","Data":"25739b2930d20dbcf11e4d531d66336c4dd966c5e59dbb1dd032525e786d657e"}
Sep 15 09:32:29.546297 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:29.546174    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"
Sep 15 09:32:29.562929 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:29.562876    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb" podStartSLOduration=1.562860685 podStartE2EDuration="1.562860685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:32:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:32:29.560977185 +0000 UTC m=+1113.210393281" watchObservedRunningTime="2026-09-15 09:32:29.562860685 +0000 UTC m=+1113.212276778"
Sep 15 09:32:36.301365 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:36.301326    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:40.555329 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:40.555302    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"
Sep 15 09:32:49.438000 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:49.437967    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:50.113809 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:50.113747    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:50.904150 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:50.904114    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:51.543605 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:51.543570    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:52.218959 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:52.218929    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:52.935509 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:52.935478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:53.477066 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:53.477027    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:53.686611 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:53.684285    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:54.109928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:54.109900    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:54.237869 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:54.237829    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:32:54.608663 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:32:54.608623    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:00.183656 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:00.183602    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:00.239639 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:00.239602    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:01.140862 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:01.140831    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:01.857045 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:01.857008    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:02.084994 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:02.084962    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:02.796856 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:02.796823    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:03.639291 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:03.639247    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:04.261988 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:04.261955    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:04.920656 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:04.920626    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:05.727835 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:05.727801    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:11.009148 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.009105    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:11.037225 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.037192    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"]
Sep 15 09:33:11.037486 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.037452    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb" podUID="bdde323a-d12b-418e-9edb-964972309599" containerName="payload-processing" containerID="cri-o://efc3a7fa379fa1577bd3a3c80fe816155591d5a8ba05d55b412de583a5cd92f5" gracePeriod=30
Sep 15 09:33:11.109528 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.109495    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:11.208350 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.208324    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:11.311288 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.311265    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"
Sep 15 09:33:11.318989 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.318961    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdde323a-d12b-418e-9edb-964972309599-plugins-config-volume\") pod \"bdde323a-d12b-418e-9edb-964972309599\" (UID: \"bdde323a-d12b-418e-9edb-964972309599\") "
Sep 15 09:33:11.319105 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.319032    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzm5m\" (UniqueName: \"kubernetes.io/projected/bdde323a-d12b-418e-9edb-964972309599-kube-api-access-lzm5m\") pod \"bdde323a-d12b-418e-9edb-964972309599\" (UID: \"bdde323a-d12b-418e-9edb-964972309599\") "
Sep 15 09:33:11.319410 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.319379    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdde323a-d12b-418e-9edb-964972309599-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bdde323a-d12b-418e-9edb-964972309599" (UID: "bdde323a-d12b-418e-9edb-964972309599"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:33:11.321314 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.321288    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdde323a-d12b-418e-9edb-964972309599-kube-api-access-lzm5m" (OuterVolumeSpecName: "kube-api-access-lzm5m") pod "bdde323a-d12b-418e-9edb-964972309599" (UID: "bdde323a-d12b-418e-9edb-964972309599"). InnerVolumeSpecName "kube-api-access-lzm5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:33:11.368242 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.368205    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:11.420023 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.419997    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdde323a-d12b-418e-9edb-964972309599-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:33:11.420023 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.420020    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzm5m\" (UniqueName: \"kubernetes.io/projected/bdde323a-d12b-418e-9edb-964972309599-kube-api-access-lzm5m\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:33:11.546943 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.546845    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:11.646596 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.646547    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:11.780208 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.780175    2575 generic.go:356] "Generic (PLEG): container finished" podID="bdde323a-d12b-418e-9edb-964972309599" containerID="efc3a7fa379fa1577bd3a3c80fe816155591d5a8ba05d55b412de583a5cd92f5" exitCode=0
Sep 15 09:33:11.780392 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.780235    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"
Sep 15 09:33:11.780392 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.780234    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb" event={"ID":"bdde323a-d12b-418e-9edb-964972309599","Type":"ContainerDied","Data":"efc3a7fa379fa1577bd3a3c80fe816155591d5a8ba05d55b412de583a5cd92f5"}
Sep 15 09:33:11.780392 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.780376    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb" event={"ID":"bdde323a-d12b-418e-9edb-964972309599","Type":"ContainerDied","Data":"25739b2930d20dbcf11e4d531d66336c4dd966c5e59dbb1dd032525e786d657e"}
Sep 15 09:33:11.780508 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.780403    2575 scope.go:117] "RemoveContainer" containerID="efc3a7fa379fa1577bd3a3c80fe816155591d5a8ba05d55b412de583a5cd92f5"
Sep 15 09:33:11.790321 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.790305    2575 scope.go:117] "RemoveContainer" containerID="efc3a7fa379fa1577bd3a3c80fe816155591d5a8ba05d55b412de583a5cd92f5"
Sep 15 09:33:11.790597 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:33:11.790579    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efc3a7fa379fa1577bd3a3c80fe816155591d5a8ba05d55b412de583a5cd92f5\": container with ID starting with efc3a7fa379fa1577bd3a3c80fe816155591d5a8ba05d55b412de583a5cd92f5 not found: ID does not exist" containerID="efc3a7fa379fa1577bd3a3c80fe816155591d5a8ba05d55b412de583a5cd92f5"
Sep 15 09:33:11.790649 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.790605    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efc3a7fa379fa1577bd3a3c80fe816155591d5a8ba05d55b412de583a5cd92f5"} err="failed to get container status \"efc3a7fa379fa1577bd3a3c80fe816155591d5a8ba05d55b412de583a5cd92f5\": rpc error: code = NotFound desc = could not find container \"efc3a7fa379fa1577bd3a3c80fe816155591d5a8ba05d55b412de583a5cd92f5\": container with ID starting with efc3a7fa379fa1577bd3a3c80fe816155591d5a8ba05d55b412de583a5cd92f5 not found: ID does not exist"
Sep 15 09:33:11.800547 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.800491    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"]
Sep 15 09:33:11.804156 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:11.804136    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8df9f24a-b58644dbf-4k5jb"]
Sep 15 09:33:12.527365 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:12.527322    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:12.860085 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:12.860006    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdde323a-d12b-418e-9edb-964972309599" path="/var/lib/kubelet/pods/bdde323a-d12b-418e-9edb-964972309599/volumes"
Sep 15 09:33:13.228207 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:13.228169    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:13.925919 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:13.925884    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:14.717472 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:14.717439    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:15.406606 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:15.406566    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:17.116060 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:17.116022    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:17.216651 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:17.216619    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:17.376047 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:17.375959    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:17.784172 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:17.784067    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:17.870193 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:17.870158    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:17.969819 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:17.969789    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:18.387278 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:18.387250    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:23.516195 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:23.516127    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:23.763538 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:23.763506    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:23.863696 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:23.863594    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:23.961506 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:23.961475    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:24.153559 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:24.153527    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:29.782782 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:29.782729    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:29.882681 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:29.882650    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:30.679075 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:30.679034    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:30.969657 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:30.969584    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"]
Sep 15 09:33:30.970062 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:30.970048    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdde323a-d12b-418e-9edb-964972309599" containerName="payload-processing"
Sep 15 09:33:30.970109 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:30.970063    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdde323a-d12b-418e-9edb-964972309599" containerName="payload-processing"
Sep 15 09:33:30.970154 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:30.970145    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdde323a-d12b-418e-9edb-964972309599" containerName="payload-processing"
Sep 15 09:33:30.973215 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:30.973191    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:30.975437 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:30.975420    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-f514a4-openshift-default-dockercfg-zw98f\""
Sep 15 09:33:30.983492 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:30.983463    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"]
Sep 15 09:33:30.988577 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:30.988554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:31.095027 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.094996    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-workload-socket\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.095027 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.095031    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-token\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.095240 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.095051    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-data\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.095240 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.095065    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-podinfo\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.095240 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.095081    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp7xx\" (UniqueName: \"kubernetes.io/projected/01c903f2-8a23-400f-936d-e50f0e4e9dc1-kube-api-access-zp7xx\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.095240 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.095140    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-workload-certs\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.095240 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.095161    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istiod-ca-cert\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.095240 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.095213    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-envoy\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.095427 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.095293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-credential-socket\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.196052 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.196016    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-credential-socket\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.196052 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.196056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-workload-socket\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.196293 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.196072    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-token\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.196293 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.196091    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-data\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.196293 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.196209    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-podinfo\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.196293 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.196241    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp7xx\" (UniqueName: \"kubernetes.io/projected/01c903f2-8a23-400f-936d-e50f0e4e9dc1-kube-api-access-zp7xx\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.196517 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.196307    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-workload-certs\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.196517 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.196338    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istiod-ca-cert\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.196517 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.196426    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-envoy\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.196517 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.196451    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-workload-socket\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.196668 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.196518    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-credential-socket\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.196668 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.196557    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-data\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.196806 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.196670    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-workload-certs\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.197049 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.197030    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istiod-ca-cert\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.198692 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.198671    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-envoy\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.198838 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.198823    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-podinfo\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.204506 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.204486    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-token\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.204653 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.204635    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp7xx\" (UniqueName: \"kubernetes.io/projected/01c903f2-8a23-400f-936d-e50f0e4e9dc1-kube-api-access-zp7xx\") pod \"e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") " pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.285867 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.285753    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:31.375232 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.375203    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:31.565548 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.565525    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"]
Sep 15 09:33:31.567879 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:33:31.567846    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01c903f2_8a23_400f_936d_e50f0e4e9dc1.slice/crio-de64de653a0f03f9b5e1d163594b1c2d3b8d0b015186b144620166078116a096 WatchSource:0}: Error finding container de64de653a0f03f9b5e1d163594b1c2d3b8d0b015186b144620166078116a096: Status 404 returned error can't find the container with id de64de653a0f03f9b5e1d163594b1c2d3b8d0b015186b144620166078116a096
Sep 15 09:33:31.570642 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.570593    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:33:31.570741 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.570706    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:33:31.570839 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.570749    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:33:31.895020 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.894989    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7" event={"ID":"01c903f2-8a23-400f-936d-e50f0e4e9dc1","Type":"ContainerStarted","Data":"18d953f9ce28a5a9bcf7b28241c8e5a66a5940d8fcb550c5fec73c886bd1fd00"}
Sep 15 09:33:31.895184 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.895044    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7" event={"ID":"01c903f2-8a23-400f-936d-e50f0e4e9dc1","Type":"ContainerStarted","Data":"de64de653a0f03f9b5e1d163594b1c2d3b8d0b015186b144620166078116a096"}
Sep 15 09:33:31.913857 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:31.913814    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7" podStartSLOduration=1.913798235 podStartE2EDuration="1.913798235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:33:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:33:31.911441782 +0000 UTC m=+1175.560857878" watchObservedRunningTime="2026-09-15 09:33:31.913798235 +0000 UTC m=+1175.563214375"
Sep 15 09:33:32.286013 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:32.285917    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:32.291452 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:32.291427    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:32.900317 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:32.900284    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:32.901340 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:32.901317    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:33.139009 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:33.138977    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:33.898513 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:33.898483    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:33.997024 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:33.996994    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:34.846389 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:34.846353    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:35.630392 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:35.630356    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:36.326548 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:36.326514    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:36.975945 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:36.975913    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:37.746321 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:37.746280    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:37.802907 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:37.802877    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:37.955443 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:37.955406    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:38.369424 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:38.369374    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:38.460645 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:38.460614    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:38.607072 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:38.607036    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"]
Sep 15 09:33:38.611004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:38.610987    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"
Sep 15 09:33:38.613404 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:38.613381    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-f514a4-dockercfg-hhdgs\""
Sep 15 09:33:38.613513 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:38.613381    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-f514a4\""
Sep 15 09:33:38.621596 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:38.621537    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"]
Sep 15 09:33:38.768820 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:38.768790    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bn85\" (UniqueName: \"kubernetes.io/projected/ac759898-f93c-4b80-bd0e-93c498f7b827-kube-api-access-5bn85\") pod \"payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz\" (UID: \"ac759898-f93c-4b80-bd0e-93c498f7b827\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"
Sep 15 09:33:38.768987 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:38.768928    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac759898-f93c-4b80-bd0e-93c498f7b827-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz\" (UID: \"ac759898-f93c-4b80-bd0e-93c498f7b827\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"
Sep 15 09:33:38.870272 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:38.870236    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bn85\" (UniqueName: \"kubernetes.io/projected/ac759898-f93c-4b80-bd0e-93c498f7b827-kube-api-access-5bn85\") pod \"payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz\" (UID: \"ac759898-f93c-4b80-bd0e-93c498f7b827\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"
Sep 15 09:33:38.870467 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:38.870343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac759898-f93c-4b80-bd0e-93c498f7b827-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz\" (UID: \"ac759898-f93c-4b80-bd0e-93c498f7b827\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"
Sep 15 09:33:38.871008 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:38.870990    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac759898-f93c-4b80-bd0e-93c498f7b827-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz\" (UID: \"ac759898-f93c-4b80-bd0e-93c498f7b827\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"
Sep 15 09:33:38.879135 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:38.879073    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bn85\" (UniqueName: \"kubernetes.io/projected/ac759898-f93c-4b80-bd0e-93c498f7b827-kube-api-access-5bn85\") pod \"payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz\" (UID: \"ac759898-f93c-4b80-bd0e-93c498f7b827\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"
Sep 15 09:33:38.897395 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:38.897367    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:38.924221 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:38.924194    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"
Sep 15 09:33:39.200682 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:39.200652    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"]
Sep 15 09:33:39.202490 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:33:39.202461    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac759898_f93c_4b80_bd0e_93c498f7b827.slice/crio-4f49d677c4142d97d91d0196c7bcdc99ea315ff1b5a0dfcb167fbfc89c2226c0 WatchSource:0}: Error finding container 4f49d677c4142d97d91d0196c7bcdc99ea315ff1b5a0dfcb167fbfc89c2226c0: Status 404 returned error can't find the container with id 4f49d677c4142d97d91d0196c7bcdc99ea315ff1b5a0dfcb167fbfc89c2226c0
Sep 15 09:33:39.514597 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:39.514510    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:39.943827 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:39.943789    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz" event={"ID":"ac759898-f93c-4b80-bd0e-93c498f7b827","Type":"ContainerStarted","Data":"2ab96ec7ebda0ea352f740f02d2422f02822b68c62436b721700eea5772b8abe"}
Sep 15 09:33:39.944393 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:39.944127    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"
Sep 15 09:33:39.944582 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:39.944565    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz" event={"ID":"ac759898-f93c-4b80-bd0e-93c498f7b827","Type":"ContainerStarted","Data":"4f49d677c4142d97d91d0196c7bcdc99ea315ff1b5a0dfcb167fbfc89c2226c0"}
Sep 15 09:33:39.961753 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:39.961709    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz" podStartSLOduration=1.961695974 podStartE2EDuration="1.961695974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:33:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:33:39.960281728 +0000 UTC m=+1183.609697821" watchObservedRunningTime="2026-09-15 09:33:39.961695974 +0000 UTC m=+1183.611112068"
Sep 15 09:33:40.219732 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:40.219644    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:40.855467 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:40.855412    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:41.641040 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:41.641001    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:42.288694 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:42.288665    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:44.309073 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:44.309041    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:44.410014 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:44.409954    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:46.750821 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:46.750783    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:47.330739 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:47.330697    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:47.399638 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:47.399599    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:47.455685 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:47.455626    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:47.528179 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:47.528143    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:47.626513 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:47.626431    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:47.891024 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:47.890996    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:48.044405 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:48.044374    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:48.865718 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:48.865674    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:49.807933 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:49.807888    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:50.541228 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:50.541197    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:51.320519 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:51.320485    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:51.960229 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:51.960192    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"
Sep 15 09:33:52.242993 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:52.242908    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:52.987086 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:52.987049    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:53.623575 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:53.623532    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:53.822245 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:53.822165    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:53.963187 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:53.963149    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:54.262184 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:54.262153    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:54.577929 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:54.577845    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:54.772736 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:54.772707    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:55.507518 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:55.507488    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:56.146152 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:56.146117    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:56.880994 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:56.880911    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:33:56.881444 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:56.881427    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:33:56.886644 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:56.886613    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:33:56.887675 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:56.887658    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:33:57.044148 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:57.044060    2575 generic.go:356] "Generic (PLEG): container finished" podID="01c903f2-8a23-400f-936d-e50f0e4e9dc1" containerID="18d953f9ce28a5a9bcf7b28241c8e5a66a5940d8fcb550c5fec73c886bd1fd00" exitCode=0
Sep 15 09:33:57.044148 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:57.044129    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7" event={"ID":"01c903f2-8a23-400f-936d-e50f0e4e9dc1","Type":"ContainerDied","Data":"18d953f9ce28a5a9bcf7b28241c8e5a66a5940d8fcb550c5fec73c886bd1fd00"}
Sep 15 09:33:57.044608 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:57.044590    2575 scope.go:117] "RemoveContainer" containerID="18d953f9ce28a5a9bcf7b28241c8e5a66a5940d8fcb550c5fec73c886bd1fd00"
Sep 15 09:33:57.045882 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:57.045846    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:33:57.046009 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:57.045918    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:33:57.046009 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:57.045955    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:33:57.054196 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:57.054166    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:57.628809 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:57.628754    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:57.744542 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:57.744503    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:57.892333 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:57.892295    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:58.058804 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:58.058737    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7" event={"ID":"01c903f2-8a23-400f-936d-e50f0e4e9dc1","Type":"ContainerStarted","Data":"24a3e33c3bc5b641cf9dc6c71612005a03c0d25fd5952230bc450225dd0cdad9"}
Sep 15 09:33:58.286496 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:58.286400    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:33:58.287936 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:58.287908    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 15 09:33:58.288064 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:58.287962    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7" podUID="01c903f2-8a23-400f-936d-e50f0e4e9dc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 15 09:33:58.612313 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:58.612219    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:33:59.286130 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:59.286097    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 15 09:33:59.286507 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:59.286150    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7" podUID="01c903f2-8a23-400f-936d-e50f0e4e9dc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 15 09:33:59.355404 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:33:59.355368    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:00.286391 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:00.286351    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 15 09:34:00.286803 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:00.286416    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7" podUID="01c903f2-8a23-400f-936d-e50f0e4e9dc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 15 09:34:00.305389 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:00.305353    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:01.013068 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:01.013032    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:01.286809 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:01.286692    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 15 09:34:01.286809 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:01.286753    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7" podUID="01c903f2-8a23-400f-936d-e50f0e4e9dc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 15 09:34:01.859842 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:01.859801    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:02.286579 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:02.286541    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 15 09:34:02.286793 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:02.286600    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7" podUID="01c903f2-8a23-400f-936d-e50f0e4e9dc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 15 09:34:02.675503 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:02.675469    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:02.738914 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:02.738853    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:02.900218 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:02.900179    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:34:02.931591 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:02.931521    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:03.192614 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:03.192533    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:03.286701 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:03.286670    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 15 09:34:03.286894 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:03.286722    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7" podUID="01c903f2-8a23-400f-936d-e50f0e4e9dc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 15 09:34:03.292112 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:03.292084    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:04.290490 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:04.290450    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:34:04.291731 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:04.291711    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:34:14.196668 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:14.196634    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:15.601499 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:15.601453    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:24.690020 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:24.689974    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:25.499092 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:25.499060    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:26.414146 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:26.414113    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:26.914134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:26.914099    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:27.551935 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:27.551898    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:27.660103 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:27.660069    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:28.223346 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:28.223320    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:28.364041 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:28.364010    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7555-4cc617"]
Sep 15 09:34:28.366839 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:28.366819    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-4cc617"
Sep 15 09:34:28.369323 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:28.369298    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-88s6f\""
Sep 15 09:34:28.375806 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:28.375067    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-4cc617"]
Sep 15 09:34:28.462312 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:28.462278    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bszwx\" (UniqueName: \"kubernetes.io/projected/6d98164b-0f29-40a3-96bc-35434619f8cf-kube-api-access-bszwx\") pod \"test-curl-7555-4cc617\" (UID: \"6d98164b-0f29-40a3-96bc-35434619f8cf\") " pod="opendatahub/test-curl-7555-4cc617"
Sep 15 09:34:28.563578 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:28.563495    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bszwx\" (UniqueName: \"kubernetes.io/projected/6d98164b-0f29-40a3-96bc-35434619f8cf-kube-api-access-bszwx\") pod \"test-curl-7555-4cc617\" (UID: \"6d98164b-0f29-40a3-96bc-35434619f8cf\") " pod="opendatahub/test-curl-7555-4cc617"
Sep 15 09:34:28.573247 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:28.573219    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bszwx\" (UniqueName: \"kubernetes.io/projected/6d98164b-0f29-40a3-96bc-35434619f8cf-kube-api-access-bszwx\") pod \"test-curl-7555-4cc617\" (UID: \"6d98164b-0f29-40a3-96bc-35434619f8cf\") " pod="opendatahub/test-curl-7555-4cc617"
Sep 15 09:34:28.679231 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:28.679200    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-4cc617"
Sep 15 09:34:28.952799 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:28.952750    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-4cc617"]
Sep 15 09:34:28.953445 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:34:28.953418    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d98164b_0f29_40a3_96bc_35434619f8cf.slice/crio-7b6e362f2ffc0681b83ad5de89ba74acf32fce83be7ef3216499677e76bb312b WatchSource:0}: Error finding container 7b6e362f2ffc0681b83ad5de89ba74acf32fce83be7ef3216499677e76bb312b: Status 404 returned error can't find the container with id 7b6e362f2ffc0681b83ad5de89ba74acf32fce83be7ef3216499677e76bb312b
Sep 15 09:34:28.955854 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:28.955833    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:34:29.128030 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:29.127992    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:29.244177 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:29.244099    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-4cc617" event={"ID":"6d98164b-0f29-40a3-96bc-35434619f8cf","Type":"ContainerStarted","Data":"7b6e362f2ffc0681b83ad5de89ba74acf32fce83be7ef3216499677e76bb312b"}
Sep 15 09:34:29.870936 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:29.870898    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:30.104961 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:30.104930    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:30.517639 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:30.517598    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:31.122288 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:31.122252    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:31.223104 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:31.223069    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:32.267055 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:32.267012    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-4cc617" event={"ID":"6d98164b-0f29-40a3-96bc-35434619f8cf","Type":"ContainerStarted","Data":"28c3d8ff9e93519d0b371acae42ac037589b26016824fccb63dd2211e2ed97fe"}
Sep 15 09:34:32.287356 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:32.287317    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7555-4cc617" podStartSLOduration=1.6289311720000001 podStartE2EDuration="4.287302459s" totalImagesPullingTime="2.658371287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:34:32.284479563 +0000 UTC m=+1235.933895658" watchObservedRunningTime="2026-09-15 09:34:32.287302459 +0000 UTC m=+1235.936718552"
Sep 15 09:34:32.294530 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:32.294498    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:32.393811 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:32.393753    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:32.493858 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:32.493826    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:32.862095 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:32.862056    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7555-4cc617"]
Sep 15 09:34:32.867272 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:32.867240    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7555-4cc617"]
Sep 15 09:34:32.980587 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:32.980496    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7555-6587c3"]
Sep 15 09:34:32.980998 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:32.980984    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d98164b-0f29-40a3-96bc-35434619f8cf" containerName="test-curl-7555-4cc617"
Sep 15 09:34:32.981051 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:32.980999    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d98164b-0f29-40a3-96bc-35434619f8cf" containerName="test-curl-7555-4cc617"
Sep 15 09:34:32.981088 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:32.981075    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d98164b-0f29-40a3-96bc-35434619f8cf" containerName="test-curl-7555-4cc617"
Sep 15 09:34:32.983702 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:32.983687    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-6587c3"
Sep 15 09:34:32.990208 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:32.990178    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-6587c3"]
Sep 15 09:34:33.001689 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:33.001659    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz7sq\" (UniqueName: \"kubernetes.io/projected/11caf444-867b-4e6c-bdd6-0556c27dfe6d-kube-api-access-pz7sq\") pod \"test-curl-7555-6587c3\" (UID: \"11caf444-867b-4e6c-bdd6-0556c27dfe6d\") " pod="opendatahub/test-curl-7555-6587c3"
Sep 15 09:34:33.102749 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:33.102716    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz7sq\" (UniqueName: \"kubernetes.io/projected/11caf444-867b-4e6c-bdd6-0556c27dfe6d-kube-api-access-pz7sq\") pod \"test-curl-7555-6587c3\" (UID: \"11caf444-867b-4e6c-bdd6-0556c27dfe6d\") " pod="opendatahub/test-curl-7555-6587c3"
Sep 15 09:34:33.110676 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:33.110650    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz7sq\" (UniqueName: \"kubernetes.io/projected/11caf444-867b-4e6c-bdd6-0556c27dfe6d-kube-api-access-pz7sq\") pod \"test-curl-7555-6587c3\" (UID: \"11caf444-867b-4e6c-bdd6-0556c27dfe6d\") " pod="opendatahub/test-curl-7555-6587c3"
Sep 15 09:34:33.273272 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:33.273194    2575 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7555-4cc617" container="test-curl-7555-4cc617"
Sep 15 09:34:33.295378 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:33.295348    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-6587c3"
Sep 15 09:34:33.571873 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:33.571849    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-6587c3"]
Sep 15 09:34:33.573717 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:34:33.573689    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11caf444_867b_4e6c_bdd6_0556c27dfe6d.slice/crio-4e63765c1624a729849b3f54b494b0f8bf4b77b5becd30d42cde1dab4a1d6c27 WatchSource:0}: Error finding container 4e63765c1624a729849b3f54b494b0f8bf4b77b5becd30d42cde1dab4a1d6c27: Status 404 returned error can't find the container with id 4e63765c1624a729849b3f54b494b0f8bf4b77b5becd30d42cde1dab4a1d6c27
Sep 15 09:34:33.684995 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:33.684960    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:34.279959 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:34.279928    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-6587c3" event={"ID":"11caf444-867b-4e6c-bdd6-0556c27dfe6d","Type":"ContainerStarted","Data":"e36535689998826ccd470a54c5be88b96cb8f4cb07809fc3b06b8303f59e9926"}
Sep 15 09:34:34.280463 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:34.279967    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-6587c3" event={"ID":"11caf444-867b-4e6c-bdd6-0556c27dfe6d","Type":"ContainerStarted","Data":"4e63765c1624a729849b3f54b494b0f8bf4b77b5becd30d42cde1dab4a1d6c27"}
Sep 15 09:34:34.280463 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:34.280128    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7555-4cc617" podUID="6d98164b-0f29-40a3-96bc-35434619f8cf" containerName="test-curl-7555-4cc617" containerID="cri-o://28c3d8ff9e93519d0b371acae42ac037589b26016824fccb63dd2211e2ed97fe" gracePeriod=2
Sep 15 09:34:34.293690 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:34.293658    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7555-4cc617\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="6d98164b-0f29-40a3-96bc-35434619f8cf" pod="opendatahub/test-curl-7555-4cc617"
Sep 15 09:34:34.293872 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:34.293830    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7555-6587c3" podStartSLOduration=2.293816235 podStartE2EDuration="2.293816235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:34:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:34:34.291957976 +0000 UTC m=+1237.941374068" watchObservedRunningTime="2026-09-15 09:34:34.293816235 +0000 UTC m=+1237.943232328"
Sep 15 09:34:34.868096 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:34.868052    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7555-6587c3"]
Sep 15 09:34:34.870901 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:34.870870    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7555-6587c3"]
Sep 15 09:34:34.983838 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:34.983744    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7555-3b4828"]
Sep 15 09:34:34.984396 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:34.984373    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11caf444-867b-4e6c-bdd6-0556c27dfe6d" containerName="test-curl-7555-6587c3"
Sep 15 09:34:34.984443 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:34.984402    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="11caf444-867b-4e6c-bdd6-0556c27dfe6d" containerName="test-curl-7555-6587c3"
Sep 15 09:34:34.984535 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:34.984524    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="11caf444-867b-4e6c-bdd6-0556c27dfe6d" containerName="test-curl-7555-6587c3"
Sep 15 09:34:34.987358 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:34.987334    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-3b4828"
Sep 15 09:34:34.989685 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:34.989662    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-3b4828"]
Sep 15 09:34:35.021269 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:35.021236    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk7xv\" (UniqueName: \"kubernetes.io/projected/4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d-kube-api-access-kk7xv\") pod \"test-curl-7555-3b4828\" (UID: \"4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d\") " pod="opendatahub/test-curl-7555-3b4828"
Sep 15 09:34:35.122784 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:35.122733    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk7xv\" (UniqueName: \"kubernetes.io/projected/4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d-kube-api-access-kk7xv\") pod \"test-curl-7555-3b4828\" (UID: \"4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d\") " pod="opendatahub/test-curl-7555-3b4828"
Sep 15 09:34:35.131324 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:35.131299    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk7xv\" (UniqueName: \"kubernetes.io/projected/4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d-kube-api-access-kk7xv\") pod \"test-curl-7555-3b4828\" (UID: \"4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d\") " pod="opendatahub/test-curl-7555-3b4828"
Sep 15 09:34:35.285625 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:35.285546    2575 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7555-6587c3" container="test-curl-7555-6587c3"
Sep 15 09:34:35.300295 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:35.300267    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-3b4828"
Sep 15 09:34:35.572323 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:35.572289    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-3b4828"]
Sep 15 09:34:35.573450 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:34:35.573427    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b1f57e2_c1d8_4d7d_b1a3_8ebdcd52647d.slice/crio-49e3234c7eb3912ce5658299ac9ee5e37b096498e41aac8b1e62369d069670ee WatchSource:0}: Error finding container 49e3234c7eb3912ce5658299ac9ee5e37b096498e41aac8b1e62369d069670ee: Status 404 returned error can't find the container with id 49e3234c7eb3912ce5658299ac9ee5e37b096498e41aac8b1e62369d069670ee
Sep 15 09:34:36.295723 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:36.295690    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-3b4828" event={"ID":"4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d","Type":"ContainerStarted","Data":"bfacd83b126f2c882914650af3633d9c0bc710b87f438f1b4c9b92a58df36efe"}
Sep 15 09:34:36.296102 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:36.295741    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-3b4828" event={"ID":"4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d","Type":"ContainerStarted","Data":"49e3234c7eb3912ce5658299ac9ee5e37b096498e41aac8b1e62369d069670ee"}
Sep 15 09:34:36.296102 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:36.295757    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7555-6587c3" podUID="11caf444-867b-4e6c-bdd6-0556c27dfe6d" containerName="test-curl-7555-6587c3" containerID="cri-o://e36535689998826ccd470a54c5be88b96cb8f4cb07809fc3b06b8303f59e9926" gracePeriod=2
Sep 15 09:34:36.309712 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:36.309683    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7555-6587c3\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="11caf444-867b-4e6c-bdd6-0556c27dfe6d" pod="opendatahub/test-curl-7555-6587c3"
Sep 15 09:34:36.309884 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:36.309844    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7555-3b4828" podStartSLOduration=2.309828728 podStartE2EDuration="2.309828728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:34:36.30807472 +0000 UTC m=+1239.957490813" watchObservedRunningTime="2026-09-15 09:34:36.309828728 +0000 UTC m=+1239.959244826"
Sep 15 09:34:36.311353 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:36.311330    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7555-6587c3\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="11caf444-867b-4e6c-bdd6-0556c27dfe6d" pod="opendatahub/test-curl-7555-6587c3"
Sep 15 09:34:36.448463 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:36.448443    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-4cc617"
Sep 15 09:34:36.450328 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:36.450306    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7555-6587c3\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="11caf444-867b-4e6c-bdd6-0556c27dfe6d" pod="opendatahub/test-curl-7555-6587c3"
Sep 15 09:34:36.536148 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:36.536077    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bszwx\" (UniqueName: \"kubernetes.io/projected/6d98164b-0f29-40a3-96bc-35434619f8cf-kube-api-access-bszwx\") pod \"6d98164b-0f29-40a3-96bc-35434619f8cf\" (UID: \"6d98164b-0f29-40a3-96bc-35434619f8cf\") "
Sep 15 09:34:36.538267 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:36.538247    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d98164b-0f29-40a3-96bc-35434619f8cf-kube-api-access-bszwx" (OuterVolumeSpecName: "kube-api-access-bszwx") pod "6d98164b-0f29-40a3-96bc-35434619f8cf" (UID: "6d98164b-0f29-40a3-96bc-35434619f8cf"). InnerVolumeSpecName "kube-api-access-bszwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:34:36.637157 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:36.637126    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bszwx\" (UniqueName: \"kubernetes.io/projected/6d98164b-0f29-40a3-96bc-35434619f8cf-kube-api-access-bszwx\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:34:36.858129 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:36.858023    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7555-6587c3\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="11caf444-867b-4e6c-bdd6-0556c27dfe6d" pod="opendatahub/test-curl-7555-6587c3"
Sep 15 09:34:36.862909 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:36.861361    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d98164b-0f29-40a3-96bc-35434619f8cf" path="/var/lib/kubelet/pods/6d98164b-0f29-40a3-96bc-35434619f8cf/volumes"
Sep 15 09:34:36.871083 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:36.871048    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7555-3b4828"]
Sep 15 09:34:36.874310 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:36.874284    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7555-3b4828"]
Sep 15 09:34:36.984373 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:36.984339    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7555-0d4f1b"]
Sep 15 09:34:36.984858 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:36.984842    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d" containerName="test-curl-7555-3b4828"
Sep 15 09:34:36.984910 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:36.984864    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d" containerName="test-curl-7555-3b4828"
Sep 15 09:34:36.984957 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:36.984948    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d" containerName="test-curl-7555-3b4828"
Sep 15 09:34:36.987394 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:36.987375    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-0d4f1b"
Sep 15 09:34:36.992497 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:36.992472    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-0d4f1b"]
Sep 15 09:34:37.042709 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:37.042675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb5wp\" (UniqueName: \"kubernetes.io/projected/484413c7-bcb6-4587-b2df-47eef07bd3e8-kube-api-access-gb5wp\") pod \"test-curl-7555-0d4f1b\" (UID: \"484413c7-bcb6-4587-b2df-47eef07bd3e8\") " pod="opendatahub/test-curl-7555-0d4f1b"
Sep 15 09:34:37.143739 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:37.143700    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb5wp\" (UniqueName: \"kubernetes.io/projected/484413c7-bcb6-4587-b2df-47eef07bd3e8-kube-api-access-gb5wp\") pod \"test-curl-7555-0d4f1b\" (UID: \"484413c7-bcb6-4587-b2df-47eef07bd3e8\") " pod="opendatahub/test-curl-7555-0d4f1b"
Sep 15 09:34:37.156798 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:37.156745    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb5wp\" (UniqueName: \"kubernetes.io/projected/484413c7-bcb6-4587-b2df-47eef07bd3e8-kube-api-access-gb5wp\") pod \"test-curl-7555-0d4f1b\" (UID: \"484413c7-bcb6-4587-b2df-47eef07bd3e8\") " pod="opendatahub/test-curl-7555-0d4f1b"
Sep 15 09:34:37.297844 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:37.297812    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-0d4f1b"
Sep 15 09:34:37.305836 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:37.305807    2575 generic.go:356] "Generic (PLEG): container finished" podID="6d98164b-0f29-40a3-96bc-35434619f8cf" containerID="28c3d8ff9e93519d0b371acae42ac037589b26016824fccb63dd2211e2ed97fe" exitCode=137
Sep 15 09:34:37.306002 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:37.305868    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-4cc617"
Sep 15 09:34:37.306002 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:37.305896    2575 scope.go:117] "RemoveContainer" containerID="28c3d8ff9e93519d0b371acae42ac037589b26016824fccb63dd2211e2ed97fe"
Sep 15 09:34:37.306121 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:37.306104    2575 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7555-3b4828" container="test-curl-7555-3b4828"
Sep 15 09:34:37.330145 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:37.330107    2575 scope.go:117] "RemoveContainer" containerID="28c3d8ff9e93519d0b371acae42ac037589b26016824fccb63dd2211e2ed97fe"
Sep 15 09:34:37.330485 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:37.330456    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28c3d8ff9e93519d0b371acae42ac037589b26016824fccb63dd2211e2ed97fe\": container with ID starting with 28c3d8ff9e93519d0b371acae42ac037589b26016824fccb63dd2211e2ed97fe not found: ID does not exist" containerID="28c3d8ff9e93519d0b371acae42ac037589b26016824fccb63dd2211e2ed97fe"
Sep 15 09:34:37.330542 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:37.330488    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28c3d8ff9e93519d0b371acae42ac037589b26016824fccb63dd2211e2ed97fe"} err="failed to get container status \"28c3d8ff9e93519d0b371acae42ac037589b26016824fccb63dd2211e2ed97fe\": rpc error: code = NotFound desc = could not find container \"28c3d8ff9e93519d0b371acae42ac037589b26016824fccb63dd2211e2ed97fe\": container with ID starting with 28c3d8ff9e93519d0b371acae42ac037589b26016824fccb63dd2211e2ed97fe not found: ID does not exist"
Sep 15 09:34:37.571839 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:37.571813    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-0d4f1b"]
Sep 15 09:34:37.573886 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:34:37.573862    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod484413c7_bcb6_4587_b2df_47eef07bd3e8.slice/crio-7d210957bf661eee983af68c18f648f069d0e7bfde01f822ac803862e11362fa WatchSource:0}: Error finding container 7d210957bf661eee983af68c18f648f069d0e7bfde01f822ac803862e11362fa: Status 404 returned error can't find the container with id 7d210957bf661eee983af68c18f648f069d0e7bfde01f822ac803862e11362fa
Sep 15 09:34:38.313452 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:38.313426    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-0d4f1b" event={"ID":"484413c7-bcb6-4587-b2df-47eef07bd3e8","Type":"ContainerStarted","Data":"c215881e37fa5620d9f3561b2d4b01d759172c1f40116186b2c47839528bf23d"}
Sep 15 09:34:38.313824 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:38.313464    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-0d4f1b" event={"ID":"484413c7-bcb6-4587-b2df-47eef07bd3e8","Type":"ContainerStarted","Data":"7d210957bf661eee983af68c18f648f069d0e7bfde01f822ac803862e11362fa"}
Sep 15 09:34:38.313824 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:38.313516    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7555-3b4828" podUID="4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d" containerName="test-curl-7555-3b4828" containerID="cri-o://bfacd83b126f2c882914650af3633d9c0bc710b87f438f1b4c9b92a58df36efe" gracePeriod=2
Sep 15 09:34:38.327204 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:38.327173    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7555-3b4828\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d" pod="opendatahub/test-curl-7555-3b4828"
Sep 15 09:34:38.327485 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:38.327451    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7555-0d4f1b" podStartSLOduration=2.327437324 podStartE2EDuration="2.327437324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:34:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:34:38.325373861 +0000 UTC m=+1241.974789954" watchObservedRunningTime="2026-09-15 09:34:38.327437324 +0000 UTC m=+1241.976853455"
Sep 15 09:34:38.328886 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:38.328860    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7555-3b4828\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d" pod="opendatahub/test-curl-7555-3b4828"
Sep 15 09:34:38.486956 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:38.486924    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-6587c3"
Sep 15 09:34:38.488926 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:38.488898    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7555-3b4828\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d" pod="opendatahub/test-curl-7555-3b4828"
Sep 15 09:34:38.559029 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:38.558952    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz7sq\" (UniqueName: \"kubernetes.io/projected/11caf444-867b-4e6c-bdd6-0556c27dfe6d-kube-api-access-pz7sq\") pod \"11caf444-867b-4e6c-bdd6-0556c27dfe6d\" (UID: \"11caf444-867b-4e6c-bdd6-0556c27dfe6d\") "
Sep 15 09:34:38.561433 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:38.561380    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11caf444-867b-4e6c-bdd6-0556c27dfe6d-kube-api-access-pz7sq" (OuterVolumeSpecName: "kube-api-access-pz7sq") pod "11caf444-867b-4e6c-bdd6-0556c27dfe6d" (UID: "11caf444-867b-4e6c-bdd6-0556c27dfe6d"). InnerVolumeSpecName "kube-api-access-pz7sq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:34:38.660124 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:38.660093    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz7sq\" (UniqueName: \"kubernetes.io/projected/11caf444-867b-4e6c-bdd6-0556c27dfe6d-kube-api-access-pz7sq\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:34:38.860088 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:38.860009    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11caf444-867b-4e6c-bdd6-0556c27dfe6d" path="/var/lib/kubelet/pods/11caf444-867b-4e6c-bdd6-0556c27dfe6d/volumes"
Sep 15 09:34:38.922558 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:38.922527    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7555-0d4f1b"]
Sep 15 09:34:38.925652 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:38.925622    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7555-0d4f1b"]
Sep 15 09:34:39.319807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:39.319751    2575 generic.go:356] "Generic (PLEG): container finished" podID="11caf444-867b-4e6c-bdd6-0556c27dfe6d" containerID="e36535689998826ccd470a54c5be88b96cb8f4cb07809fc3b06b8303f59e9926" exitCode=137
Sep 15 09:34:39.320247 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:39.319811    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-6587c3"
Sep 15 09:34:39.320247 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:39.319850    2575 scope.go:117] "RemoveContainer" containerID="e36535689998826ccd470a54c5be88b96cb8f4cb07809fc3b06b8303f59e9926"
Sep 15 09:34:39.320247 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:39.320102    2575 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7555-0d4f1b" container="test-curl-7555-0d4f1b"
Sep 15 09:34:39.329205 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:39.329190    2575 scope.go:117] "RemoveContainer" containerID="e36535689998826ccd470a54c5be88b96cb8f4cb07809fc3b06b8303f59e9926"
Sep 15 09:34:39.329467 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:39.329448    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e36535689998826ccd470a54c5be88b96cb8f4cb07809fc3b06b8303f59e9926\": container with ID starting with e36535689998826ccd470a54c5be88b96cb8f4cb07809fc3b06b8303f59e9926 not found: ID does not exist" containerID="e36535689998826ccd470a54c5be88b96cb8f4cb07809fc3b06b8303f59e9926"
Sep 15 09:34:39.329538 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:39.329474    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e36535689998826ccd470a54c5be88b96cb8f4cb07809fc3b06b8303f59e9926"} err="failed to get container status \"e36535689998826ccd470a54c5be88b96cb8f4cb07809fc3b06b8303f59e9926\": rpc error: code = NotFound desc = could not find container \"e36535689998826ccd470a54c5be88b96cb8f4cb07809fc3b06b8303f59e9926\": container with ID starting with e36535689998826ccd470a54c5be88b96cb8f4cb07809fc3b06b8303f59e9926 not found: ID does not exist"
Sep 15 09:34:39.497699 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:39.497663    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:39.797657 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:39.797624    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:40.326318 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:40.326291    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7555-0d4f1b" podUID="484413c7-bcb6-4587-b2df-47eef07bd3e8" containerName="test-curl-7555-0d4f1b" containerID="cri-o://c215881e37fa5620d9f3561b2d4b01d759172c1f40116186b2c47839528bf23d" gracePeriod=2
Sep 15 09:34:40.328279 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:40.328254    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7555-0d4f1b\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="484413c7-bcb6-4587-b2df-47eef07bd3e8" pod="opendatahub/test-curl-7555-0d4f1b"
Sep 15 09:34:40.439819 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:40.439792    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:40.509386 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:40.509359    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-3b4828"
Sep 15 09:34:40.511345 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:40.511317    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7555-0d4f1b\" is forbidden: User \"system:node:ip-10-0-136-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-31.ec2.internal' and this object" podUID="484413c7-bcb6-4587-b2df-47eef07bd3e8" pod="opendatahub/test-curl-7555-0d4f1b"
Sep 15 09:34:40.578747 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:40.578662    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk7xv\" (UniqueName: \"kubernetes.io/projected/4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d-kube-api-access-kk7xv\") pod \"4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d\" (UID: \"4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d\") "
Sep 15 09:34:40.580883 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:40.580849    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d-kube-api-access-kk7xv" (OuterVolumeSpecName: "kube-api-access-kk7xv") pod "4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d" (UID: "4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d"). InnerVolumeSpecName "kube-api-access-kk7xv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:34:40.679792 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:40.679725    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk7xv\" (UniqueName: \"kubernetes.io/projected/4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d-kube-api-access-kk7xv\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:34:40.867458 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:40.867380    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d" path="/var/lib/kubelet/pods/4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d/volumes"
Sep 15 09:34:41.332792 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:41.332747    2575 generic.go:356] "Generic (PLEG): container finished" podID="4b1f57e2-c1d8-4d7d-b1a3-8ebdcd52647d" containerID="bfacd83b126f2c882914650af3633d9c0bc710b87f438f1b4c9b92a58df36efe" exitCode=137
Sep 15 09:34:41.333177 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:41.332814    2575 scope.go:117] "RemoveContainer" containerID="bfacd83b126f2c882914650af3633d9c0bc710b87f438f1b4c9b92a58df36efe"
Sep 15 09:34:41.333177 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:41.332814    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-3b4828"
Sep 15 09:34:41.345850 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:41.345757    2575 scope.go:117] "RemoveContainer" containerID="bfacd83b126f2c882914650af3633d9c0bc710b87f438f1b4c9b92a58df36efe"
Sep 15 09:34:41.346402 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:41.346370    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfacd83b126f2c882914650af3633d9c0bc710b87f438f1b4c9b92a58df36efe\": container with ID starting with bfacd83b126f2c882914650af3633d9c0bc710b87f438f1b4c9b92a58df36efe not found: ID does not exist" containerID="bfacd83b126f2c882914650af3633d9c0bc710b87f438f1b4c9b92a58df36efe"
Sep 15 09:34:41.346516 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:41.346408    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfacd83b126f2c882914650af3633d9c0bc710b87f438f1b4c9b92a58df36efe"} err="failed to get container status \"bfacd83b126f2c882914650af3633d9c0bc710b87f438f1b4c9b92a58df36efe\": rpc error: code = NotFound desc = could not find container \"bfacd83b126f2c882914650af3633d9c0bc710b87f438f1b4c9b92a58df36efe\": container with ID starting with bfacd83b126f2c882914650af3633d9c0bc710b87f438f1b4c9b92a58df36efe not found: ID does not exist"
Sep 15 09:34:42.231216 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:42.231176    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:42.509304 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:42.509279    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-0d4f1b"
Sep 15 09:34:42.597824 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:42.597791    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb5wp\" (UniqueName: \"kubernetes.io/projected/484413c7-bcb6-4587-b2df-47eef07bd3e8-kube-api-access-gb5wp\") pod \"484413c7-bcb6-4587-b2df-47eef07bd3e8\" (UID: \"484413c7-bcb6-4587-b2df-47eef07bd3e8\") "
Sep 15 09:34:42.599980 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:42.599954    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/484413c7-bcb6-4587-b2df-47eef07bd3e8-kube-api-access-gb5wp" (OuterVolumeSpecName: "kube-api-access-gb5wp") pod "484413c7-bcb6-4587-b2df-47eef07bd3e8" (UID: "484413c7-bcb6-4587-b2df-47eef07bd3e8"). InnerVolumeSpecName "kube-api-access-gb5wp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:34:42.698817 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:42.698754    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb5wp\" (UniqueName: \"kubernetes.io/projected/484413c7-bcb6-4587-b2df-47eef07bd3e8-kube-api-access-gb5wp\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:34:42.860735 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:42.860659    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="484413c7-bcb6-4587-b2df-47eef07bd3e8" path="/var/lib/kubelet/pods/484413c7-bcb6-4587-b2df-47eef07bd3e8/volumes"
Sep 15 09:34:43.027005 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:43.026968    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:43.131558 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:43.131461    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:43.349210 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:43.349174    2575 generic.go:356] "Generic (PLEG): container finished" podID="484413c7-bcb6-4587-b2df-47eef07bd3e8" containerID="c215881e37fa5620d9f3561b2d4b01d759172c1f40116186b2c47839528bf23d" exitCode=137
Sep 15 09:34:43.349407 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:43.349216    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-0d4f1b"
Sep 15 09:34:43.349407 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:43.349242    2575 scope.go:117] "RemoveContainer" containerID="c215881e37fa5620d9f3561b2d4b01d759172c1f40116186b2c47839528bf23d"
Sep 15 09:34:43.358503 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:43.358487    2575 scope.go:117] "RemoveContainer" containerID="c215881e37fa5620d9f3561b2d4b01d759172c1f40116186b2c47839528bf23d"
Sep 15 09:34:43.358812 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:34:43.358791    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c215881e37fa5620d9f3561b2d4b01d759172c1f40116186b2c47839528bf23d\": container with ID starting with c215881e37fa5620d9f3561b2d4b01d759172c1f40116186b2c47839528bf23d not found: ID does not exist" containerID="c215881e37fa5620d9f3561b2d4b01d759172c1f40116186b2c47839528bf23d"
Sep 15 09:34:43.358889 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:43.358826    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c215881e37fa5620d9f3561b2d4b01d759172c1f40116186b2c47839528bf23d"} err="failed to get container status \"c215881e37fa5620d9f3561b2d4b01d759172c1f40116186b2c47839528bf23d\": rpc error: code = NotFound desc = could not find container \"c215881e37fa5620d9f3561b2d4b01d759172c1f40116186b2c47839528bf23d\": container with ID starting with c215881e37fa5620d9f3561b2d4b01d759172c1f40116186b2c47839528bf23d not found: ID does not exist"
Sep 15 09:34:43.860026 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:43.859994    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:44.650414 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:44.650384    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:45.428078 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:45.428048    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:46.063454 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:46.063416    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:46.816634 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:46.816601    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:47.470954 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:47.470922    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:47.531404 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:47.531373    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:47.634249 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:47.634219    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:47.924334 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:47.924306    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:48.012938 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:48.012906    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:34:48.014490 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:48.014468    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"]
Sep 15 09:34:48.014968 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:48.014955    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="484413c7-bcb6-4587-b2df-47eef07bd3e8" containerName="test-curl-7555-0d4f1b"
Sep 15 09:34:48.015012 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:48.014969    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="484413c7-bcb6-4587-b2df-47eef07bd3e8" containerName="test-curl-7555-0d4f1b"
Sep 15 09:34:48.015057 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:48.015047    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="484413c7-bcb6-4587-b2df-47eef07bd3e8" containerName="test-curl-7555-0d4f1b"
Sep 15 09:34:48.019401 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:48.019386    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"
Sep 15 09:34:48.021838 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:48.021818    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-312334ca\""
Sep 15 09:34:48.028028 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:48.028002    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"]
Sep 15 09:34:48.149932 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:48.149892    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8a0c7a4-9da8-4289-bb46-2ab69975c958-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v\" (UID: \"d8a0c7a4-9da8-4289-bb46-2ab69975c958\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"
Sep 15 09:34:48.150181 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:48.150158    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nj84\" (UniqueName: \"kubernetes.io/projected/d8a0c7a4-9da8-4289-bb46-2ab69975c958-kube-api-access-8nj84\") pod \"payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v\" (UID: \"d8a0c7a4-9da8-4289-bb46-2ab69975c958\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"
Sep 15 09:34:48.250921 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:48.250837    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nj84\" (UniqueName: \"kubernetes.io/projected/d8a0c7a4-9da8-4289-bb46-2ab69975c958-kube-api-access-8nj84\") pod \"payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v\" (UID: \"d8a0c7a4-9da8-4289-bb46-2ab69975c958\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"
Sep 15 09:34:48.250921 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:48.250895    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8a0c7a4-9da8-4289-bb46-2ab69975c958-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v\" (UID: \"d8a0c7a4-9da8-4289-bb46-2ab69975c958\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"
Sep 15 09:34:48.251599 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:48.251579    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8a0c7a4-9da8-4289-bb46-2ab69975c958-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v\" (UID: \"d8a0c7a4-9da8-4289-bb46-2ab69975c958\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"
Sep 15 09:34:48.259328 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:48.259291    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nj84\" (UniqueName: \"kubernetes.io/projected/d8a0c7a4-9da8-4289-bb46-2ab69975c958-kube-api-access-8nj84\") pod \"payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v\" (UID: \"d8a0c7a4-9da8-4289-bb46-2ab69975c958\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"
Sep 15 09:34:48.330756 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:48.330724    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"
Sep 15 09:34:48.605960 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:48.605932    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"]
Sep 15 09:34:48.607414 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:34:48.607380    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8a0c7a4_9da8_4289_bb46_2ab69975c958.slice/crio-e3c904a6ceb99f37a013ed6b385fce13b658c73f96d9b5c0f0a071f95dc63ee4 WatchSource:0}: Error finding container e3c904a6ceb99f37a013ed6b385fce13b658c73f96d9b5c0f0a071f95dc63ee4: Status 404 returned error can't find the container with id e3c904a6ceb99f37a013ed6b385fce13b658c73f96d9b5c0f0a071f95dc63ee4
Sep 15 09:34:49.387311 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:49.387280    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v" event={"ID":"d8a0c7a4-9da8-4289-bb46-2ab69975c958","Type":"ContainerStarted","Data":"76f7a609b7f9d90e32408355d05f6639a1168193787a9a573a2db33953a8e903"}
Sep 15 09:34:49.387727 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:49.387335    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"
Sep 15 09:34:49.387727 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:49.387351    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v" event={"ID":"d8a0c7a4-9da8-4289-bb46-2ab69975c958","Type":"ContainerStarted","Data":"e3c904a6ceb99f37a013ed6b385fce13b658c73f96d9b5c0f0a071f95dc63ee4"}
Sep 15 09:34:49.402069 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:34:49.402019    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v" podStartSLOduration=2.402004095 podStartE2EDuration="2.402004095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:34:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:34:49.401255695 +0000 UTC m=+1253.050671789" watchObservedRunningTime="2026-09-15 09:34:49.402004095 +0000 UTC m=+1253.051420166"
Sep 15 09:35:00.396574 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:35:00.396542    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"
Sep 15 09:35:09.522152 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:35:09.522118    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:35:11.394230 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:35:11.394195    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:35:11.719951 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:35:11.719851    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:35:12.449691 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:35:12.449659    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:35:13.085460 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:35:13.085420    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:35:13.184032 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:35:13.183997    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:35:13.931834 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:35:13.931807    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:35:14.571822 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:35:14.571781    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:35:18.313388 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:35:18.313359    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:35:19.016316 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:35:19.016284    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:35:20.065390 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:35:20.065353    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:35:27.502227 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:35:27.502191    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:35:42.340802 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:35:42.340729    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:35:50.852424 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:35:50.852385    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:00.640341 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:00.640300    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:00.860618 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:00.860578    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:00.991858 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:00.991749    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:06.008476 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:06.008442    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:09.144420 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:09.144376    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:09.931350 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:09.931314    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:10.732668 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:10.732629    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:11.634792 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:11.634737    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:11.735094 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:11.735064    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:12.050097 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:12.050059    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:12.738390 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:12.738353    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:13.392412 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:13.392362    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:13.554675 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:13.554644    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:14.209136 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:14.209099    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:14.304501 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:14.304468    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:14.878346 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:14.878314    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:19.676587 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:19.676510    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"]
Sep 15 09:36:19.677053 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:19.676782    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t" podUID="f7f21bf6-78bd-416e-ab60-d8a6f5234695" containerName="payload-processing" containerID="cri-o://9d45460f5438d97ccb6efd2c02587210f43ed79ef373563052b9faf5775a14c8" gracePeriod=30
Sep 15 09:36:19.685247 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:19.685211    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"]
Sep 15 09:36:19.685716 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:19.685648    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn" podUID="fece0b2e-61c3-418e-8585-8f3f6d7d66c3" containerName="payload-pre-processing" containerID="cri-o://5321b6d723e0d38714c510471387322116d75f5a4566cedf4e7814e04e3db807" gracePeriod=30
Sep 15 09:36:19.881926 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:19.881897    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:19.917125 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:19.916895    2575 generic.go:356] "Generic (PLEG): container finished" podID="f7f21bf6-78bd-416e-ab60-d8a6f5234695" containerID="9d45460f5438d97ccb6efd2c02587210f43ed79ef373563052b9faf5775a14c8" exitCode=0
Sep 15 09:36:19.917125 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:19.916970    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t" event={"ID":"f7f21bf6-78bd-416e-ab60-d8a6f5234695","Type":"ContainerDied","Data":"9d45460f5438d97ccb6efd2c02587210f43ed79ef373563052b9faf5775a14c8"}
Sep 15 09:36:19.919395 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:19.919291    2575 generic.go:356] "Generic (PLEG): container finished" podID="fece0b2e-61c3-418e-8585-8f3f6d7d66c3" containerID="5321b6d723e0d38714c510471387322116d75f5a4566cedf4e7814e04e3db807" exitCode=0
Sep 15 09:36:19.919395 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:19.919363    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn" event={"ID":"fece0b2e-61c3-418e-8585-8f3f6d7d66c3","Type":"ContainerDied","Data":"5321b6d723e0d38714c510471387322116d75f5a4566cedf4e7814e04e3db807"}
Sep 15 09:36:19.947573 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:19.947370    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:19.990509 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:19.990483    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"
Sep 15 09:36:19.993414 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:19.993397    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"
Sep 15 09:36:20.104127 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.104096    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fece0b2e-61c3-418e-8585-8f3f6d7d66c3-plugins-config-volume\") pod \"fece0b2e-61c3-418e-8585-8f3f6d7d66c3\" (UID: \"fece0b2e-61c3-418e-8585-8f3f6d7d66c3\") "
Sep 15 09:36:20.104127 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.104134    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rk9hf\" (UniqueName: \"kubernetes.io/projected/fece0b2e-61c3-418e-8585-8f3f6d7d66c3-kube-api-access-rk9hf\") pod \"fece0b2e-61c3-418e-8585-8f3f6d7d66c3\" (UID: \"fece0b2e-61c3-418e-8585-8f3f6d7d66c3\") "
Sep 15 09:36:20.104386 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.104157    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7f21bf6-78bd-416e-ab60-d8a6f5234695-plugins-config-volume\") pod \"f7f21bf6-78bd-416e-ab60-d8a6f5234695\" (UID: \"f7f21bf6-78bd-416e-ab60-d8a6f5234695\") "
Sep 15 09:36:20.104386 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.104178    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knkwg\" (UniqueName: \"kubernetes.io/projected/f7f21bf6-78bd-416e-ab60-d8a6f5234695-kube-api-access-knkwg\") pod \"f7f21bf6-78bd-416e-ab60-d8a6f5234695\" (UID: \"f7f21bf6-78bd-416e-ab60-d8a6f5234695\") "
Sep 15 09:36:20.104508 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.104458    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fece0b2e-61c3-418e-8585-8f3f6d7d66c3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fece0b2e-61c3-418e-8585-8f3f6d7d66c3" (UID: "fece0b2e-61c3-418e-8585-8f3f6d7d66c3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:36:20.104508 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.104456    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7f21bf6-78bd-416e-ab60-d8a6f5234695-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f7f21bf6-78bd-416e-ab60-d8a6f5234695" (UID: "f7f21bf6-78bd-416e-ab60-d8a6f5234695"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:36:20.106493 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.106469    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fece0b2e-61c3-418e-8585-8f3f6d7d66c3-kube-api-access-rk9hf" (OuterVolumeSpecName: "kube-api-access-rk9hf") pod "fece0b2e-61c3-418e-8585-8f3f6d7d66c3" (UID: "fece0b2e-61c3-418e-8585-8f3f6d7d66c3"). InnerVolumeSpecName "kube-api-access-rk9hf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:36:20.106596 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.106563    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7f21bf6-78bd-416e-ab60-d8a6f5234695-kube-api-access-knkwg" (OuterVolumeSpecName: "kube-api-access-knkwg") pod "f7f21bf6-78bd-416e-ab60-d8a6f5234695" (UID: "f7f21bf6-78bd-416e-ab60-d8a6f5234695"). InnerVolumeSpecName "kube-api-access-knkwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:36:20.193536 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.193505    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:20.205928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.205867    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fece0b2e-61c3-418e-8585-8f3f6d7d66c3-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:36:20.205928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.205889    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rk9hf\" (UniqueName: \"kubernetes.io/projected/fece0b2e-61c3-418e-8585-8f3f6d7d66c3-kube-api-access-rk9hf\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:36:20.205928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.205907    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7f21bf6-78bd-416e-ab60-d8a6f5234695-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:36:20.205928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.205917    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knkwg\" (UniqueName: \"kubernetes.io/projected/f7f21bf6-78bd-416e-ab60-d8a6f5234695-kube-api-access-knkwg\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:36:20.295045 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.295006    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:20.926093 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.926063    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"
Sep 15 09:36:20.926531 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.926110    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t" event={"ID":"f7f21bf6-78bd-416e-ab60-d8a6f5234695","Type":"ContainerDied","Data":"971dded7397bc87197dcb4528f205ffb060c95d28e1779988cf7e405ffc67178"}
Sep 15 09:36:20.926531 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.926179    2575 scope.go:117] "RemoveContainer" containerID="9d45460f5438d97ccb6efd2c02587210f43ed79ef373563052b9faf5775a14c8"
Sep 15 09:36:20.928810 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.928472    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn" event={"ID":"fece0b2e-61c3-418e-8585-8f3f6d7d66c3","Type":"ContainerDied","Data":"3657851cb912a930dd19fd323f3dd581053f161c7d51136bff697a5972eeeaca"}
Sep 15 09:36:20.928810 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.928571    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"
Sep 15 09:36:20.936464 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.936443    2575 scope.go:117] "RemoveContainer" containerID="5321b6d723e0d38714c510471387322116d75f5a4566cedf4e7814e04e3db807"
Sep 15 09:36:20.949173 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.949148    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"]
Sep 15 09:36:20.954416 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.954393    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:20.955316 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.955299    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7a31d6-84698797b5-2wr2t"]
Sep 15 09:36:20.964347 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.964324    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"]
Sep 15 09:36:20.972688 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:20.972666    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7a31d6-d58dfcd6b-flnzn"]
Sep 15 09:36:21.727712 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:21.727676    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:22.642278 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:22.642242    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:22.859021 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:22.858993    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7f21bf6-78bd-416e-ab60-d8a6f5234695" path="/var/lib/kubelet/pods/f7f21bf6-78bd-416e-ab60-d8a6f5234695/volumes"
Sep 15 09:36:22.859347 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:22.859335    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fece0b2e-61c3-418e-8585-8f3f6d7d66c3" path="/var/lib/kubelet/pods/fece0b2e-61c3-418e-8585-8f3f6d7d66c3/volumes"
Sep 15 09:36:23.296224 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:23.296188    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:23.946191 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:23.946151    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:24.842744 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:24.842710    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:25.784065 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:25.784029    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:25.884251 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:25.884223    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:26.048199 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:26.048109    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:26.550723 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:26.550684    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:27.315873 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:27.315830    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:27.519980 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:27.519938    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:28.208522 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:28.208490    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:29.022545 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:29.022496    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:29.754853 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:29.754811    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:30.544937 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:30.544901    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:31.206421 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:31.206392    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:31.820877 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:31.820831    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:36.872121 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:36.872087    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-0e280a-29824410-zmrfh"]
Sep 15 09:36:36.873079 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:36.873056    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:36.874354 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:36.874334    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-0e280a-29824410-zmrfh"]
Sep 15 09:36:36.899558 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:36.899526    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"]
Sep 15 09:36:36.899948 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:36.899820    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x" podUID="b6a5c7c1-2435-4313-b46a-952d87859200" containerName="payload-processing" containerID="cri-o://ec4a17500187ce500ccf8d36e74029708fb117b44f50254eb3b2814ca92261d2" gracePeriod=30
Sep 15 09:36:36.903895 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:36.903859    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"]
Sep 15 09:36:36.904224 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:36.904195    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2" podUID="8cac8d3e-f163-4fe3-905c-0aec12be33d7" containerName="payload-pre-processing" containerID="cri-o://0684b6f519ecbd021b3f69572f9b01ac52ccf0219318e1747258e1a62d5b7f94" gracePeriod=30
Sep 15 09:36:36.938381 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:36.938334    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:37.001409 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.001382    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:37.025694 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.025669    2575 generic.go:356] "Generic (PLEG): container finished" podID="b6a5c7c1-2435-4313-b46a-952d87859200" containerID="ec4a17500187ce500ccf8d36e74029708fb117b44f50254eb3b2814ca92261d2" exitCode=0
Sep 15 09:36:37.025901 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.025796    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x" event={"ID":"b6a5c7c1-2435-4313-b46a-952d87859200","Type":"ContainerDied","Data":"ec4a17500187ce500ccf8d36e74029708fb117b44f50254eb3b2814ca92261d2"}
Sep 15 09:36:37.028592 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.028549    2575 generic.go:356] "Generic (PLEG): container finished" podID="8cac8d3e-f163-4fe3-905c-0aec12be33d7" containerID="0684b6f519ecbd021b3f69572f9b01ac52ccf0219318e1747258e1a62d5b7f94" exitCode=0
Sep 15 09:36:37.028711 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.028622    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2" event={"ID":"8cac8d3e-f163-4fe3-905c-0aec12be33d7","Type":"ContainerDied","Data":"0684b6f519ecbd021b3f69572f9b01ac52ccf0219318e1747258e1a62d5b7f94"}
Sep 15 09:36:37.079183 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.079115    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:37.088552 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.088237    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2" podUID="8cac8d3e-f163-4fe3-905c-0aec12be33d7" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.53:9004: connect: connection refused"
Sep 15 09:36:37.145640 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.145591    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:37.177363 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.177339    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"
Sep 15 09:36:37.206195 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.206174    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"
Sep 15 09:36:37.268013 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.267973    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6a5c7c1-2435-4313-b46a-952d87859200-plugins-config-volume\") pod \"b6a5c7c1-2435-4313-b46a-952d87859200\" (UID: \"b6a5c7c1-2435-4313-b46a-952d87859200\") "
Sep 15 09:36:37.268216 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.268031    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7fmz\" (UniqueName: \"kubernetes.io/projected/8cac8d3e-f163-4fe3-905c-0aec12be33d7-kube-api-access-h7fmz\") pod \"8cac8d3e-f163-4fe3-905c-0aec12be33d7\" (UID: \"8cac8d3e-f163-4fe3-905c-0aec12be33d7\") "
Sep 15 09:36:37.268216 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.268055    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cac8d3e-f163-4fe3-905c-0aec12be33d7-plugins-config-volume\") pod \"8cac8d3e-f163-4fe3-905c-0aec12be33d7\" (UID: \"8cac8d3e-f163-4fe3-905c-0aec12be33d7\") "
Sep 15 09:36:37.268216 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.268086    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7k7k4\" (UniqueName: \"kubernetes.io/projected/b6a5c7c1-2435-4313-b46a-952d87859200-kube-api-access-7k7k4\") pod \"b6a5c7c1-2435-4313-b46a-952d87859200\" (UID: \"b6a5c7c1-2435-4313-b46a-952d87859200\") "
Sep 15 09:36:37.268595 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.268518    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6a5c7c1-2435-4313-b46a-952d87859200-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b6a5c7c1-2435-4313-b46a-952d87859200" (UID: "b6a5c7c1-2435-4313-b46a-952d87859200"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:36:37.268746 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.268626    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cac8d3e-f163-4fe3-905c-0aec12be33d7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8cac8d3e-f163-4fe3-905c-0aec12be33d7" (UID: "8cac8d3e-f163-4fe3-905c-0aec12be33d7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:36:37.270620 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.270594    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6a5c7c1-2435-4313-b46a-952d87859200-kube-api-access-7k7k4" (OuterVolumeSpecName: "kube-api-access-7k7k4") pod "b6a5c7c1-2435-4313-b46a-952d87859200" (UID: "b6a5c7c1-2435-4313-b46a-952d87859200"). InnerVolumeSpecName "kube-api-access-7k7k4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:36:37.270734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.270655    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cac8d3e-f163-4fe3-905c-0aec12be33d7-kube-api-access-h7fmz" (OuterVolumeSpecName: "kube-api-access-h7fmz") pod "8cac8d3e-f163-4fe3-905c-0aec12be33d7" (UID: "8cac8d3e-f163-4fe3-905c-0aec12be33d7"). InnerVolumeSpecName "kube-api-access-h7fmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:36:37.369380 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.369335    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7k7k4\" (UniqueName: \"kubernetes.io/projected/b6a5c7c1-2435-4313-b46a-952d87859200-kube-api-access-7k7k4\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:36:37.369380 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.369372    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6a5c7c1-2435-4313-b46a-952d87859200-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:36:37.369380 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.369385    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7fmz\" (UniqueName: \"kubernetes.io/projected/8cac8d3e-f163-4fe3-905c-0aec12be33d7-kube-api-access-h7fmz\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:36:37.369609 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.369398    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cac8d3e-f163-4fe3-905c-0aec12be33d7-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:36:37.437243 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.437210    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:37.602128 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:37.602093    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:38.037099 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:38.037074    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"
Sep 15 09:36:38.037559 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:38.037100    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2" event={"ID":"8cac8d3e-f163-4fe3-905c-0aec12be33d7","Type":"ContainerDied","Data":"54878161f69558da674ffc2a9700729097c51a12b6904959437a438380df766d"}
Sep 15 09:36:38.037559 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:38.037170    2575 scope.go:117] "RemoveContainer" containerID="0684b6f519ecbd021b3f69572f9b01ac52ccf0219318e1747258e1a62d5b7f94"
Sep 15 09:36:38.038790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:38.038744    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"
Sep 15 09:36:38.038924 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:38.038740    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x" event={"ID":"b6a5c7c1-2435-4313-b46a-952d87859200","Type":"ContainerDied","Data":"1c4237618a914e5e839f27b7cd2b3d30dc458b00ffe484c818f4e77efe0bdcef"}
Sep 15 09:36:38.049016 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:38.049001    2575 scope.go:117] "RemoveContainer" containerID="ec4a17500187ce500ccf8d36e74029708fb117b44f50254eb3b2814ca92261d2"
Sep 15 09:36:38.060589 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:38.060565    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"]
Sep 15 09:36:38.066752 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:38.066722    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0e280a-b4cf77fb6-4c7t2"]
Sep 15 09:36:38.075897 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:38.075872    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"]
Sep 15 09:36:38.079488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:38.079462    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x"]
Sep 15 09:36:38.088401 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:38.088371    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-inf-b-0e280a-5f6dc8cc7f-j249x" podUID="b6a5c7c1-2435-4313-b46a-952d87859200" containerName="payload-processing" probeResult="failure" output="dial tcp 10.133.0.54:9004: i/o timeout"
Sep 15 09:36:38.302139 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:38.302057    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:38.859900 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:38.859867    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3282a614-4c2a-42fd-972f-d988af61d208" path="/var/lib/kubelet/pods/3282a614-4c2a-42fd-972f-d988af61d208/volumes"
Sep 15 09:36:38.860217 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:38.860204    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cac8d3e-f163-4fe3-905c-0aec12be33d7" path="/var/lib/kubelet/pods/8cac8d3e-f163-4fe3-905c-0aec12be33d7/volumes"
Sep 15 09:36:38.860512 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:38.860501    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6a5c7c1-2435-4313-b46a-952d87859200" path="/var/lib/kubelet/pods/b6a5c7c1-2435-4313-b46a-952d87859200/volumes"
Sep 15 09:36:39.179093 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:39.179067    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:39.731709 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:39.731679    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:40.518437 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:40.518406    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:41.328588 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:41.328553    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:43.053181 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.053145    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:43.296433 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.296401    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"]
Sep 15 09:36:43.297405 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.297377    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7f21bf6-78bd-416e-ab60-d8a6f5234695" containerName="payload-processing"
Sep 15 09:36:43.297567 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.297551    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7f21bf6-78bd-416e-ab60-d8a6f5234695" containerName="payload-processing"
Sep 15 09:36:43.297680 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.297667    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cac8d3e-f163-4fe3-905c-0aec12be33d7" containerName="payload-pre-processing"
Sep 15 09:36:43.297792 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.297757    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cac8d3e-f163-4fe3-905c-0aec12be33d7" containerName="payload-pre-processing"
Sep 15 09:36:43.297928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.297902    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a5c7c1-2435-4313-b46a-952d87859200" containerName="payload-processing"
Sep 15 09:36:43.297928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.297920    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a5c7c1-2435-4313-b46a-952d87859200" containerName="payload-processing"
Sep 15 09:36:43.298113 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.297937    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fece0b2e-61c3-418e-8585-8f3f6d7d66c3" containerName="payload-pre-processing"
Sep 15 09:36:43.298113 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.297946    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fece0b2e-61c3-418e-8585-8f3f6d7d66c3" containerName="payload-pre-processing"
Sep 15 09:36:43.298113 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.298080    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fece0b2e-61c3-418e-8585-8f3f6d7d66c3" containerName="payload-pre-processing"
Sep 15 09:36:43.298113 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.298095    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cac8d3e-f163-4fe3-905c-0aec12be33d7" containerName="payload-pre-processing"
Sep 15 09:36:43.298113 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.298109    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7f21bf6-78bd-416e-ab60-d8a6f5234695" containerName="payload-processing"
Sep 15 09:36:43.298347 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.298122    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6a5c7c1-2435-4313-b46a-952d87859200" containerName="payload-processing"
Sep 15 09:36:43.302598 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.302581    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.305961 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.305902    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-e76bac\"/\"kube-root-ca.crt\""
Sep 15 09:36:43.306079 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.306042    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e76bac\"/\"distinct-2-w0-e76bac-kserve-self-signed-certs\""
Sep 15 09:36:43.306079 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.305902    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-e76bac\"/\"openshift-service-ca.crt\""
Sep 15 09:36:43.306293 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.306270    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e76bac\"/\"default-dockercfg-sjjrz\""
Sep 15 09:36:43.309295 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.309271    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"]
Sep 15 09:36:43.324423 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.324393    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-dshm\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.324561 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.324425    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5t6q\" (UniqueName: \"kubernetes.io/projected/952ee430-3394-49f5-9764-a30c91dbb1fe-kube-api-access-v5t6q\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.324561 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.324458    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/952ee430-3394-49f5-9764-a30c91dbb1fe-tls-certs\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.324561 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.324524    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-home\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.324747 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.324573    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-tmp-dir\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.324747 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.324602    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-model-cache\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.325226 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.325195    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:43.425140 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.425111    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-tmp-dir\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.425287 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.425147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-model-cache\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.425287 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.425261    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-dshm\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.425393 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.425288    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5t6q\" (UniqueName: \"kubernetes.io/projected/952ee430-3394-49f5-9764-a30c91dbb1fe-kube-api-access-v5t6q\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.425393 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.425320    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/952ee430-3394-49f5-9764-a30c91dbb1fe-tls-certs\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.425501 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.425465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-home\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.425601 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.425563    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-tmp-dir\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.425601 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.425585    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-model-cache\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.425816 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.425796    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-home\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.427713 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.427691    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-dshm\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.427970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.427953    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/952ee430-3394-49f5-9764-a30c91dbb1fe-tls-certs\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.433008 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.432986    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5t6q\" (UniqueName: \"kubernetes.io/projected/952ee430-3394-49f5-9764-a30c91dbb1fe-kube-api-access-v5t6q\") pod \"distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") " pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.615426 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.615329    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:43.631129 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.631085    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:43.690597 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.690569    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:43.889227 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.889193    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"]
Sep 15 09:36:43.890608 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:36:43.890578    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod952ee430_3394_49f5_9764_a30c91dbb1fe.slice/crio-2c821690ca86c30b2e1a3417c2f8a69573cff9cf63810c33067c0f7a68b2e5c9 WatchSource:0}: Error finding container 2c821690ca86c30b2e1a3417c2f8a69573cff9cf63810c33067c0f7a68b2e5c9: Status 404 returned error can't find the container with id 2c821690ca86c30b2e1a3417c2f8a69573cff9cf63810c33067c0f7a68b2e5c9
Sep 15 09:36:43.897957 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:43.897829    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:44.077697 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.077641    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp" event={"ID":"952ee430-3394-49f5-9764-a30c91dbb1fe","Type":"ContainerStarted","Data":"abcb91d219c51126ca5d568d466d6e400253096d43b9fb07bd9e6a6bc50090a2"}
Sep 15 09:36:44.078245 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.078213    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp" event={"ID":"952ee430-3394-49f5-9764-a30c91dbb1fe","Type":"ContainerStarted","Data":"2c821690ca86c30b2e1a3417c2f8a69573cff9cf63810c33067c0f7a68b2e5c9"}
Sep 15 09:36:44.094025 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.093973    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp" podStartSLOduration=1.09395891 podStartE2EDuration="1.09395891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:36:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:36:44.09348467 +0000 UTC m=+1367.742900764" watchObservedRunningTime="2026-09-15 09:36:44.09395891 +0000 UTC m=+1367.743375002"
Sep 15 09:36:44.472787 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.472734    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:44.757021 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.756922    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"]
Sep 15 09:36:44.760998 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.760975    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.763157 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.763135    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-864b9a-openshift-default-dockercfg-xv6vx\""
Sep 15 09:36:44.771272 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.771252    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"]
Sep 15 09:36:44.780552 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.780509    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:44.839127 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.839088    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-workload-socket\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.839286 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.839138    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-podinfo\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.839286 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.839165    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-credential-socket\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.839286 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.839189    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzvff\" (UniqueName: \"kubernetes.io/projected/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-kube-api-access-tzvff\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.839286 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.839218    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istiod-ca-cert\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.839431 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.839362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-token\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.839431 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.839417    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-workload-certs\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.839496 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.839451    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-data\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.839531 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.839511    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-envoy\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.926575 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.926537    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:44.941091 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.941058    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istiod-ca-cert\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.941273 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.941150    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-token\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.941273 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.941189    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-workload-certs\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.941273 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.941222    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-data\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.941448 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.941284    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-envoy\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.941448 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.941368    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-workload-socket\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.941448 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.941403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-podinfo\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.941448 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.941429    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-credential-socket\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.941645 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.941453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzvff\" (UniqueName: \"kubernetes.io/projected/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-kube-api-access-tzvff\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.941944 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.941916    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istiod-ca-cert\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.942046 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.941985    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-workload-certs\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.942107 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.942044    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-workload-socket\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.942204 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.942182    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-data\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.942446 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.942421    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-credential-socket\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.944779 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.944712    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-envoy\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.945861 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.945837    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-podinfo\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.949052 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.949028    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-token\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:44.949185 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:44.949164    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzvff\" (UniqueName: \"kubernetes.io/projected/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-kube-api-access-tzvff\") pod \"e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") " pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:45.074812 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:45.074702    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:45.359382 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:45.359299    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"]
Sep 15 09:36:45.362330 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:36:45.362302    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c767bdb_daea_45af_b9d9_8a2dbbe254bd.slice/crio-6741c705b27b0f743b9bdc150ae445fbe96a33a1d08d7964dac1c7235b2434b3 WatchSource:0}: Error finding container 6741c705b27b0f743b9bdc150ae445fbe96a33a1d08d7964dac1c7235b2434b3: Status 404 returned error can't find the container with id 6741c705b27b0f743b9bdc150ae445fbe96a33a1d08d7964dac1c7235b2434b3
Sep 15 09:36:45.364979 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:45.364924    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:36:45.365066 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:45.365033    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:36:45.365110 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:45.365083    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:36:46.091148 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:46.091110    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm" event={"ID":"5c767bdb-daea-45af-b9d9-8a2dbbe254bd","Type":"ContainerStarted","Data":"6a2031250b28e9b75ea9d49a0f5bc571bc742e8c924cf36ca1178e232a04b99d"}
Sep 15 09:36:46.091324 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:46.091171    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm" event={"ID":"5c767bdb-daea-45af-b9d9-8a2dbbe254bd","Type":"ContainerStarted","Data":"6741c705b27b0f743b9bdc150ae445fbe96a33a1d08d7964dac1c7235b2434b3"}
Sep 15 09:36:46.110195 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:46.110146    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm" podStartSLOduration=2.110131711 podStartE2EDuration="2.110131711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:36:46.109106274 +0000 UTC m=+1369.758522367" watchObservedRunningTime="2026-09-15 09:36:46.110131711 +0000 UTC m=+1369.759547804"
Sep 15 09:36:47.075728 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:47.075682    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:47.081004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:47.080978    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:47.096537 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:47.096513    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:47.097313 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:47.097298    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:36:47.389115 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:47.389069    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:48.116378 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:48.116343    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:48.215600 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:48.215568    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:49.028274 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:49.028241    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:50.020965 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:50.020928    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:50.922012 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:50.921968    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:51.584835 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:51.584798    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:52.249634 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:52.249605    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:52.350848 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:52.350814    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:52.405056 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:52.405026    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:52.829401 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:52.829367    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:52.924851 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:52.924815    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:52.929215 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:52.929189    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"]
Sep 15 09:36:52.933081 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:52.933064    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"
Sep 15 09:36:52.935367 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:52.935350    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-864b9a\""
Sep 15 09:36:52.935500 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:52.935393    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-864b9a-dockercfg-5bhbl\""
Sep 15 09:36:52.943120 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:52.943026    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"]
Sep 15 09:36:53.019468 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:53.019429    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d2effad-1aa6-4a83-a1bd-807cfe037e32-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k\" (UID: \"5d2effad-1aa6-4a83-a1bd-807cfe037e32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"
Sep 15 09:36:53.019680 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:53.019580    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phcgs\" (UniqueName: \"kubernetes.io/projected/5d2effad-1aa6-4a83-a1bd-807cfe037e32-kube-api-access-phcgs\") pod \"payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k\" (UID: \"5d2effad-1aa6-4a83-a1bd-807cfe037e32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"
Sep 15 09:36:53.121098 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:53.120997    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phcgs\" (UniqueName: \"kubernetes.io/projected/5d2effad-1aa6-4a83-a1bd-807cfe037e32-kube-api-access-phcgs\") pod \"payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k\" (UID: \"5d2effad-1aa6-4a83-a1bd-807cfe037e32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"
Sep 15 09:36:53.121098 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:53.121073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d2effad-1aa6-4a83-a1bd-807cfe037e32-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k\" (UID: \"5d2effad-1aa6-4a83-a1bd-807cfe037e32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"
Sep 15 09:36:53.121849 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:53.121830    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d2effad-1aa6-4a83-a1bd-807cfe037e32-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k\" (UID: \"5d2effad-1aa6-4a83-a1bd-807cfe037e32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"
Sep 15 09:36:53.131572 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:53.131550    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phcgs\" (UniqueName: \"kubernetes.io/projected/5d2effad-1aa6-4a83-a1bd-807cfe037e32-kube-api-access-phcgs\") pod \"payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k\" (UID: \"5d2effad-1aa6-4a83-a1bd-807cfe037e32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"
Sep 15 09:36:53.245790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:53.245727    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"
Sep 15 09:36:53.339431 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:53.339398    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:53.520438 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:53.520413    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"]
Sep 15 09:36:53.522131 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:36:53.522094    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d2effad_1aa6_4a83_a1bd_807cfe037e32.slice/crio-6c39cabb737eb36331bc511a1bf6612409c36df382453bc745033ba6d4e15dd3 WatchSource:0}: Error finding container 6c39cabb737eb36331bc511a1bf6612409c36df382453bc745033ba6d4e15dd3: Status 404 returned error can't find the container with id 6c39cabb737eb36331bc511a1bf6612409c36df382453bc745033ba6d4e15dd3
Sep 15 09:36:53.616120 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:53.616083    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:53.616262 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:53.616133    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:53.629687 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:53.629664    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:54.121873 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:54.121830    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:54.135710 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:54.135673    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k" event={"ID":"5d2effad-1aa6-4a83-a1bd-807cfe037e32","Type":"ContainerStarted","Data":"9b5fee30536ec4d2d01dbf428f232e594ef1cb9406d1017c0fa504ffdf1ee47e"}
Sep 15 09:36:54.135929 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:54.135731    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k" event={"ID":"5d2effad-1aa6-4a83-a1bd-807cfe037e32","Type":"ContainerStarted","Data":"6c39cabb737eb36331bc511a1bf6612409c36df382453bc745033ba6d4e15dd3"}
Sep 15 09:36:54.147613 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:54.147587    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:36:54.152299 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:54.152251    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k" podStartSLOduration=2.152232742 podStartE2EDuration="2.152232742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:36:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:36:54.151630856 +0000 UTC m=+1377.801046962" watchObservedRunningTime="2026-09-15 09:36:54.152232742 +0000 UTC m=+1377.801648840"
Sep 15 09:36:54.906830 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:54.906751    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:55.140735 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:55.140710    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"
Sep 15 09:36:55.643405 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:55.643352    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:56.213499 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:56.213471    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:36:56.980939 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:56.980911    2575 scope.go:117] "RemoveContainer" containerID="91ce7567ac8dbbdfb35458d499becbf16e31f2284e312835bcca9ca007596cbf"
Sep 15 09:36:59.962395 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:36:59.962355    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:01.262975 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:01.262939    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:01.312230 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:01.312203    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:05.562127 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:05.562056    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:05.589338 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:05.589305    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"]
Sep 15 09:37:05.589570 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:05.589541    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v" podUID="d8a0c7a4-9da8-4289-bb46-2ab69975c958" containerName="payload-pre-processing" containerID="cri-o://76f7a609b7f9d90e32408355d05f6639a1168193787a9a573a2db33953a8e903" gracePeriod=30
Sep 15 09:37:05.664526 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:05.664480    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:05.765729 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:05.765644    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:05.861911 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:05.861750    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:05.879309 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:05.879279    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"
Sep 15 09:37:06.044967 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.044927    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nj84\" (UniqueName: \"kubernetes.io/projected/d8a0c7a4-9da8-4289-bb46-2ab69975c958-kube-api-access-8nj84\") pod \"d8a0c7a4-9da8-4289-bb46-2ab69975c958\" (UID: \"d8a0c7a4-9da8-4289-bb46-2ab69975c958\") "
Sep 15 09:37:06.045187 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.045094    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8a0c7a4-9da8-4289-bb46-2ab69975c958-plugins-config-volume\") pod \"d8a0c7a4-9da8-4289-bb46-2ab69975c958\" (UID: \"d8a0c7a4-9da8-4289-bb46-2ab69975c958\") "
Sep 15 09:37:06.045757 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.045717    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8a0c7a4-9da8-4289-bb46-2ab69975c958-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d8a0c7a4-9da8-4289-bb46-2ab69975c958" (UID: "d8a0c7a4-9da8-4289-bb46-2ab69975c958"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:37:06.048535 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.048505    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8a0c7a4-9da8-4289-bb46-2ab69975c958-kube-api-access-8nj84" (OuterVolumeSpecName: "kube-api-access-8nj84") pod "d8a0c7a4-9da8-4289-bb46-2ab69975c958" (UID: "d8a0c7a4-9da8-4289-bb46-2ab69975c958"). InnerVolumeSpecName "kube-api-access-8nj84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:37:06.146554 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.146513    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8a0c7a4-9da8-4289-bb46-2ab69975c958-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:37:06.146554 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.146557    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nj84\" (UniqueName: \"kubernetes.io/projected/d8a0c7a4-9da8-4289-bb46-2ab69975c958-kube-api-access-8nj84\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:37:06.149364 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.149340    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"
Sep 15 09:37:06.204138 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.204070    2575 generic.go:356] "Generic (PLEG): container finished" podID="d8a0c7a4-9da8-4289-bb46-2ab69975c958" containerID="76f7a609b7f9d90e32408355d05f6639a1168193787a9a573a2db33953a8e903" exitCode=0
Sep 15 09:37:06.204138 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.204118    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"
Sep 15 09:37:06.204386 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.204121    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v" event={"ID":"d8a0c7a4-9da8-4289-bb46-2ab69975c958","Type":"ContainerDied","Data":"76f7a609b7f9d90e32408355d05f6639a1168193787a9a573a2db33953a8e903"}
Sep 15 09:37:06.204386 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.204234    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v" event={"ID":"d8a0c7a4-9da8-4289-bb46-2ab69975c958","Type":"ContainerDied","Data":"e3c904a6ceb99f37a013ed6b385fce13b658c73f96d9b5c0f0a071f95dc63ee4"}
Sep 15 09:37:06.204386 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.204265    2575 scope.go:117] "RemoveContainer" containerID="76f7a609b7f9d90e32408355d05f6639a1168193787a9a573a2db33953a8e903"
Sep 15 09:37:06.217256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.217149    2575 scope.go:117] "RemoveContainer" containerID="76f7a609b7f9d90e32408355d05f6639a1168193787a9a573a2db33953a8e903"
Sep 15 09:37:06.217701 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:37:06.217664    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76f7a609b7f9d90e32408355d05f6639a1168193787a9a573a2db33953a8e903\": container with ID starting with 76f7a609b7f9d90e32408355d05f6639a1168193787a9a573a2db33953a8e903 not found: ID does not exist" containerID="76f7a609b7f9d90e32408355d05f6639a1168193787a9a573a2db33953a8e903"
Sep 15 09:37:06.217838 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.217708    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f7a609b7f9d90e32408355d05f6639a1168193787a9a573a2db33953a8e903"} err="failed to get container status \"76f7a609b7f9d90e32408355d05f6639a1168193787a9a573a2db33953a8e903\": rpc error: code = NotFound desc = could not find container \"76f7a609b7f9d90e32408355d05f6639a1168193787a9a573a2db33953a8e903\": container with ID starting with 76f7a609b7f9d90e32408355d05f6639a1168193787a9a573a2db33953a8e903 not found: ID does not exist"
Sep 15 09:37:06.239864 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.239836    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"]
Sep 15 09:37:06.248637 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.248607    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-312334ca-674bd7d58b-z8r4v"]
Sep 15 09:37:06.378638 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.378595    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:06.859721 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:06.859689    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8a0c7a4-9da8-4289-bb46-2ab69975c958" path="/var/lib/kubelet/pods/d8a0c7a4-9da8-4289-bb46-2ab69975c958/volumes"
Sep 15 09:37:07.035863 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:07.035831    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:07.932965 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:07.932926    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:08.708437 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:08.708402    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:09.083550 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:09.083451    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:09.532621 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:09.532554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:10.263155 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:10.263114    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:11.071082 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:11.071054    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:11.829939 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:11.829909    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:12.662982 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:12.662944    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:12.977318 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:12.977210    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:13.312247 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:13.312167    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:13.438133 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:13.438101    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:13.627544 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:13.627441    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:13.968058 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:13.968022    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:14.168281 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:14.168225    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:16.381074 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:16.381040    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:17.098265 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:17.098228    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 15 09:37:17.098468 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:17.098289    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm" podUID="5c767bdb-daea-45af-b9d9-8a2dbbe254bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 15 09:37:17.156306 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:17.156275    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:17.256433 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:17.256405    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:17.275199 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:17.275167    2575 generic.go:356] "Generic (PLEG): container finished" podID="5c767bdb-daea-45af-b9d9-8a2dbbe254bd" containerID="6a2031250b28e9b75ea9d49a0f5bc571bc742e8c924cf36ca1178e232a04b99d" exitCode=0
Sep 15 09:37:17.275392 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:17.275223    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm" event={"ID":"5c767bdb-daea-45af-b9d9-8a2dbbe254bd","Type":"ContainerDied","Data":"6a2031250b28e9b75ea9d49a0f5bc571bc742e8c924cf36ca1178e232a04b99d"}
Sep 15 09:37:17.275668 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:17.275652    2575 scope.go:117] "RemoveContainer" containerID="6a2031250b28e9b75ea9d49a0f5bc571bc742e8c924cf36ca1178e232a04b99d"
Sep 15 09:37:17.277032 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:17.276995    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:37:17.277141 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:17.277088    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:37:17.277141 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:17.277135    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:37:18.031749 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:18.031716    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:18.283193 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:18.283110    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm" event={"ID":"5c767bdb-daea-45af-b9d9-8a2dbbe254bd","Type":"ContainerStarted","Data":"45f0c06649617e7abd2ed4175fa712b0456d43ba4abacce9189ec6b7ef35f45b"}
Sep 15 09:37:19.074908 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:19.074875    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:37:19.075396 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:19.075122    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 15 09:37:19.075396 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:19.075182    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm" podUID="5c767bdb-daea-45af-b9d9-8a2dbbe254bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 15 09:37:19.195180 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:19.195136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:19.956848 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:19.956736    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:20.075329 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:20.075287    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 15 09:37:20.075705 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:20.075349    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm" podUID="5c767bdb-daea-45af-b9d9-8a2dbbe254bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 15 09:37:20.671339 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:20.671301    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:21.075196 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:21.075118    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 15 09:37:21.075196 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:21.075179    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm" podUID="5c767bdb-daea-45af-b9d9-8a2dbbe254bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 15 09:37:21.633378 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:21.633345    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:21.687574 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:21.687541    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:21.788438 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:21.788412    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:22.075967 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.075935    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 15 09:37:22.076160 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.076003    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm" podUID="5c767bdb-daea-45af-b9d9-8a2dbbe254bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 15 09:37:22.111595 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.111567    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:22.199411 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.199378    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:22.220807 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.220758    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"]
Sep 15 09:37:22.221259 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.221244    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8a0c7a4-9da8-4289-bb46-2ab69975c958" containerName="payload-pre-processing"
Sep 15 09:37:22.221303 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.221264    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8a0c7a4-9da8-4289-bb46-2ab69975c958" containerName="payload-pre-processing"
Sep 15 09:37:22.221342 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.221336    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8a0c7a4-9da8-4289-bb46-2ab69975c958" containerName="payload-pre-processing"
Sep 15 09:37:22.224111 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.224097    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"
Sep 15 09:37:22.226602 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.226582    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-b283ee\""
Sep 15 09:37:22.232458 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.232433    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"]
Sep 15 09:37:22.244901 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.243196    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"]
Sep 15 09:37:22.278802 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.276665    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"]
Sep 15 09:37:22.278802 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.276803    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"
Sep 15 09:37:22.280428 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.279956    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-b283ee-dockercfg-lt9lg\""
Sep 15 09:37:22.316158 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.316129    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6njjb\" (UniqueName: \"kubernetes.io/projected/690ea2d0-3693-4749-b62e-6230967a3b1d-kube-api-access-6njjb\") pod \"payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb\" (UID: \"690ea2d0-3693-4749-b62e-6230967a3b1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"
Sep 15 09:37:22.316320 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.316211    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/690ea2d0-3693-4749-b62e-6230967a3b1d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb\" (UID: \"690ea2d0-3693-4749-b62e-6230967a3b1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"
Sep 15 09:37:22.316393 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.316332    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7wz2\" (UniqueName: \"kubernetes.io/projected/1c092ea1-31da-4fb5-952d-22acfabfd4a8-kube-api-access-h7wz2\") pod \"payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74\" (UID: \"1c092ea1-31da-4fb5-952d-22acfabfd4a8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"
Sep 15 09:37:22.316393 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.316376    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c092ea1-31da-4fb5-952d-22acfabfd4a8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74\" (UID: \"1c092ea1-31da-4fb5-952d-22acfabfd4a8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"
Sep 15 09:37:22.417650 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.417611    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7wz2\" (UniqueName: \"kubernetes.io/projected/1c092ea1-31da-4fb5-952d-22acfabfd4a8-kube-api-access-h7wz2\") pod \"payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74\" (UID: \"1c092ea1-31da-4fb5-952d-22acfabfd4a8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"
Sep 15 09:37:22.417887 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.417677    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c092ea1-31da-4fb5-952d-22acfabfd4a8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74\" (UID: \"1c092ea1-31da-4fb5-952d-22acfabfd4a8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"
Sep 15 09:37:22.417887 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.417748    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6njjb\" (UniqueName: \"kubernetes.io/projected/690ea2d0-3693-4749-b62e-6230967a3b1d-kube-api-access-6njjb\") pod \"payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb\" (UID: \"690ea2d0-3693-4749-b62e-6230967a3b1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"
Sep 15 09:37:22.417887 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.417876    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/690ea2d0-3693-4749-b62e-6230967a3b1d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb\" (UID: \"690ea2d0-3693-4749-b62e-6230967a3b1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"
Sep 15 09:37:22.418482 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.418457    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c092ea1-31da-4fb5-952d-22acfabfd4a8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74\" (UID: \"1c092ea1-31da-4fb5-952d-22acfabfd4a8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"
Sep 15 09:37:22.418571 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.418533    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/690ea2d0-3693-4749-b62e-6230967a3b1d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb\" (UID: \"690ea2d0-3693-4749-b62e-6230967a3b1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"
Sep 15 09:37:22.428152 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.428119    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6njjb\" (UniqueName: \"kubernetes.io/projected/690ea2d0-3693-4749-b62e-6230967a3b1d-kube-api-access-6njjb\") pod \"payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb\" (UID: \"690ea2d0-3693-4749-b62e-6230967a3b1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"
Sep 15 09:37:22.428465 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.428444    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7wz2\" (UniqueName: \"kubernetes.io/projected/1c092ea1-31da-4fb5-952d-22acfabfd4a8-kube-api-access-h7wz2\") pod \"payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74\" (UID: \"1c092ea1-31da-4fb5-952d-22acfabfd4a8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"
Sep 15 09:37:22.537901 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.537869    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"
Sep 15 09:37:22.589746 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.589712    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"
Sep 15 09:37:22.828819 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.828796    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"]
Sep 15 09:37:22.831313 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:37:22.831287    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod690ea2d0_3693_4749_b62e_6230967a3b1d.slice/crio-3ac09e5759bcdf8b9f7a2022c8493217e5b335875cd35283256af31970a8748f WatchSource:0}: Error finding container 3ac09e5759bcdf8b9f7a2022c8493217e5b335875cd35283256af31970a8748f: Status 404 returned error can't find the container with id 3ac09e5759bcdf8b9f7a2022c8493217e5b335875cd35283256af31970a8748f
Sep 15 09:37:22.912623 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:22.912596    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"]
Sep 15 09:37:22.916080 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:37:22.916058    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c092ea1_31da_4fb5_952d_22acfabfd4a8.slice/crio-5c742e92273d8808bd2ed863f4f976cb7602a84f3e947a02a601f8b61fb032b3 WatchSource:0}: Error finding container 5c742e92273d8808bd2ed863f4f976cb7602a84f3e947a02a601f8b61fb032b3: Status 404 returned error can't find the container with id 5c742e92273d8808bd2ed863f4f976cb7602a84f3e947a02a601f8b61fb032b3
Sep 15 09:37:23.076057 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:23.076006    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 15 09:37:23.076246 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:23.076078    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm" podUID="5c767bdb-daea-45af-b9d9-8a2dbbe254bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 15 09:37:23.314112 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:23.314014    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74" event={"ID":"1c092ea1-31da-4fb5-952d-22acfabfd4a8","Type":"ContainerStarted","Data":"715167f0b07f5a5b089533639f162fe53b3da04c783212efce8656decf39aa51"}
Sep 15 09:37:23.314112 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:23.314072    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74" event={"ID":"1c092ea1-31da-4fb5-952d-22acfabfd4a8","Type":"ContainerStarted","Data":"5c742e92273d8808bd2ed863f4f976cb7602a84f3e947a02a601f8b61fb032b3"}
Sep 15 09:37:23.314344 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:23.314140    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"
Sep 15 09:37:23.316214 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:23.316186    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb" event={"ID":"690ea2d0-3693-4749-b62e-6230967a3b1d","Type":"ContainerStarted","Data":"fef685795ba636b69e90cd0595312ef7aabf3a2c487434fd53706c81cff82572"}
Sep 15 09:37:23.316387 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:23.316237    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb" event={"ID":"690ea2d0-3693-4749-b62e-6230967a3b1d","Type":"ContainerStarted","Data":"3ac09e5759bcdf8b9f7a2022c8493217e5b335875cd35283256af31970a8748f"}
Sep 15 09:37:23.316387 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:23.316289    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"
Sep 15 09:37:23.330452 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:23.330412    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74" podStartSLOduration=1.3303997189999999 podStartE2EDuration="1.330399719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:37:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:37:23.328420613 +0000 UTC m=+1406.977836706" watchObservedRunningTime="2026-09-15 09:37:23.330399719 +0000 UTC m=+1406.979815811"
Sep 15 09:37:23.344096 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:23.344041    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb" podStartSLOduration=1.344020308 podStartE2EDuration="1.344020308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:37:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:37:23.343313853 +0000 UTC m=+1406.992729948" watchObservedRunningTime="2026-09-15 09:37:23.344020308 +0000 UTC m=+1406.993436402"
Sep 15 09:37:24.080271 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:24.080240    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:37:24.080710 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:24.080686    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:37:24.081438 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:24.081420    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:37:25.896904 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:25.896872    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:30.096610 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:30.096574    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:34.323980 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:34.323936    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"
Sep 15 09:37:34.324415 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:34.324005    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"
Sep 15 09:37:43.628437 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:43.628403    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:44.384118 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:44.384086    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:45.145349 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:45.145320    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:45.767753 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:45.767721    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:45.824644 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:45.824613    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:45.922246 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:45.922212    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:46.717056 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:46.717023    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:47.153847 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:47.153812    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:47.432505 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:47.432416    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:48.240596 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:48.240558    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:50.555988 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:50.555956    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:51.000849 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:51.000807    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:37:56.550457 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:37:56.550420    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:01.724694 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:01.724651    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:06.002226 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:06.002193    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:10.961171 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:10.961132    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:11.129537 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:11.129494    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:11.220263 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:11.220166    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:12.411348 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:12.411316    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:12.510891 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:12.510848    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:12.610793 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:12.610750    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:13.220963 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:13.220925    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:13.326924 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:13.326888    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:14.591965 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:14.591920    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:19.131321 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:19.131284    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:20.299339 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:20.299295    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:20.399306 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:20.399265    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:20.960030 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:20.960000    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:24.252253 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:24.252215    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:26.698247 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:26.698213    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:26.804468 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:26.804436    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:26.903083 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:26.903052    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:37.345685 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:37.345638    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:37.545669 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:37.545630    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:39.823627 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:39.823585    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:55.991441 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:55.991402    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"]
Sep 15 09:38:55.994970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:55.994954    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:55.997272 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:55.997247    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-b283ee\"/\"openshift-service-ca.crt\""
Sep 15 09:38:55.998446 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:55.998298    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-b283ee\"/\"kube-root-ca.crt\""
Sep 15 09:38:55.998446 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:55.998419    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-b283ee\"/\"default-dockercfg-nm2c2\""
Sep 15 09:38:55.998640 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:55.998468    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-b283ee\"/\"auth-test-model-b283ee-kserve-self-signed-certs\""
Sep 15 09:38:56.001368 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.001343    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"]
Sep 15 09:38:56.122907 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.122875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-dshm\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.123103 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.122932    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-home\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.123103 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.123041    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-model-cache\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.123103 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.123086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-tmp-dir\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.123290 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.123171    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g579n\" (UniqueName: \"kubernetes.io/projected/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-kube-api-access-g579n\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.123290 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.123198    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-tls-certs\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.224625 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.224596    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g579n\" (UniqueName: \"kubernetes.io/projected/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-kube-api-access-g579n\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.224826 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.224631    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-tls-certs\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.224935 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.224913    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-dshm\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.225020 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.225006    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-home\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.225099 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.225086    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-model-cache\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.225158 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.225123    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-tmp-dir\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.225325 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.225303    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-home\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.225422 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.225380    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-model-cache\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.225481 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.225462    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-tmp-dir\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.227170 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.227148    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-dshm\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.227361 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.227345    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-tls-certs\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.232605 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.232582    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g579n\" (UniqueName: \"kubernetes.io/projected/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-kube-api-access-g579n\") pod \"auth-test-model-b283ee-kserve-5496577599-k9h7p\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") " pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.305536 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.305463    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:38:56.581286 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.581263    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"]
Sep 15 09:38:56.583018 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:38:56.582978    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ab4e4d7_9c95_4658_9994_b5c2a9ad84a0.slice/crio-e1a08b47eee4ff224f14ed080f648a12b56e029cb915e9e8be3fe2f3f3428341 WatchSource:0}: Error finding container e1a08b47eee4ff224f14ed080f648a12b56e029cb915e9e8be3fe2f3f3428341: Status 404 returned error can't find the container with id e1a08b47eee4ff224f14ed080f648a12b56e029cb915e9e8be3fe2f3f3428341
Sep 15 09:38:56.791788 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.791747    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:38:56.863778 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.863694    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p" event={"ID":"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0","Type":"ContainerStarted","Data":"fba4849cd022aa79f4f89c75232d7bd2718e3447677cc417a8423a69360336e0"}
Sep 15 09:38:56.863778 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.863727    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p" event={"ID":"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0","Type":"ContainerStarted","Data":"e1a08b47eee4ff224f14ed080f648a12b56e029cb915e9e8be3fe2f3f3428341"}
Sep 15 09:38:56.880595 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.880549    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p" podStartSLOduration=1.880532612 podStartE2EDuration="1.880532612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:38:56.878306125 +0000 UTC m=+1500.527722219" watchObservedRunningTime="2026-09-15 09:38:56.880532612 +0000 UTC m=+1500.529948706"
Sep 15 09:38:56.927053 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.927021    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:38:56.927239 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.927220    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:38:56.933255 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.933235    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:38:56.933432 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:56.933307    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:38:58.406529 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:38:58.406483    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:02.795383 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:02.795328    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:04.190896 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:04.190858    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:04.291841 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:04.291806    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:04.522408 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:04.522291    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:04.816477 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:04.816389    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:05.150550 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:05.150519    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:06.305894 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:06.305863    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:39:06.306274 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:06.306002    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:39:06.318936 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:06.318903    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:39:06.931737 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:06.931706    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:39:07.104361 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:07.104319    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:07.743798 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:07.743711    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:07.846310 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:07.846269    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:08.651792 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:08.647402    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:09.296270 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:09.296240    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:10.026110 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:10.026075    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:10.926162 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:10.926125    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:11.631060 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:11.631032    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:12.546208 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:12.546173    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:12.646571 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:12.646535    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:12.747296 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:12.747264    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:12.999740 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:12.999709    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:13.101429 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:13.101394    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:24.057561 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:24.057528    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:33.382883 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.382846    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"]
Sep 15 09:39:33.386645 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.386621    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.389405 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.389382    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e76bac\"/\"embedding-w0-e76bac-kserve-self-signed-certs\""
Sep 15 09:39:33.396577 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.396554    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"]
Sep 15 09:39:33.411119 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.411097    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:33.492637 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.492604    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-tmp-dir\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.492838 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.492667    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xr4h\" (UniqueName: \"kubernetes.io/projected/b78f5411-3e51-4455-91cd-62fdc94add9a-kube-api-access-7xr4h\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.492838 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.492696    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b78f5411-3e51-4455-91cd-62fdc94add9a-tls-certs\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.492838 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.492727    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-home\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.492838 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.492753    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-dshm\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.492996 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.492842    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-model-cache\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.533450 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.533414    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:33.593509 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.593472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xr4h\" (UniqueName: \"kubernetes.io/projected/b78f5411-3e51-4455-91cd-62fdc94add9a-kube-api-access-7xr4h\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.593509 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.593510    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b78f5411-3e51-4455-91cd-62fdc94add9a-tls-certs\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.593721 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.593552    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-home\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.593721 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.593572    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-dshm\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.593721 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.593608    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-model-cache\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.593721 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.593683    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-tmp-dir\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.594069 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.594046    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-home\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.594114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.594074    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-tmp-dir\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.594157 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.594129    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-model-cache\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.596181 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.596153    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-dshm\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.596408 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.596391    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b78f5411-3e51-4455-91cd-62fdc94add9a-tls-certs\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.601757 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.601730    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xr4h\" (UniqueName: \"kubernetes.io/projected/b78f5411-3e51-4455-91cd-62fdc94add9a-kube-api-access-7xr4h\") pod \"embedding-w0-e76bac-kserve-65558df7d4-gnbkw\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") " pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.698939 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.698901    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:33.972112 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:33.972079    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"]
Sep 15 09:39:33.973431 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:39:33.973407    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb78f5411_3e51_4455_91cd_62fdc94add9a.slice/crio-bb17ea361dfa0f684ee66919d511016ca3518faf904f509538c88989e9a74b15 WatchSource:0}: Error finding container bb17ea361dfa0f684ee66919d511016ca3518faf904f509538c88989e9a74b15: Status 404 returned error can't find the container with id bb17ea361dfa0f684ee66919d511016ca3518faf904f509538c88989e9a74b15
Sep 15 09:39:34.083945 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:34.083907    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw" event={"ID":"b78f5411-3e51-4455-91cd-62fdc94add9a","Type":"ContainerStarted","Data":"cf0eabb28d6bd49c23ff338338a79a37c49ab233f25f075088da744a560864d5"}
Sep 15 09:39:34.083945 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:34.083951    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw" event={"ID":"b78f5411-3e51-4455-91cd-62fdc94add9a","Type":"ContainerStarted","Data":"bb17ea361dfa0f684ee66919d511016ca3518faf904f509538c88989e9a74b15"}
Sep 15 09:39:34.099499 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:34.099444    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw" podStartSLOduration=1.099430281 podStartE2EDuration="1.099430281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:39:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:39:34.098906295 +0000 UTC m=+1537.748322414" watchObservedRunningTime="2026-09-15 09:39:34.099430281 +0000 UTC m=+1537.748846374"
Sep 15 09:39:34.221866 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:34.221782    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:34.837570 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:34.837528    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:35.481590 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:35.481555    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:36.232492 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:36.232461    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:37.036502 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:37.036472    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:37.618351 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:37.618317    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:37.784413 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:37.784382    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:38.218352 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:38.218323    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:38.318436 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:38.318402    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:38.526110 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:38.526034    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:38.794189 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:38.794116    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:39.137965 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:39.137936    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:39.847560 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:39.847493    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:41.335391 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:41.335342    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:42.013297 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:42.013262    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:42.107886 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:42.107857    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:42.757086 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:42.757042    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:43.500722 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:43.500680    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:43.699198 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:43.699164    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:43.699374 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:43.699211    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:43.712621 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:43.712595    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:44.155782 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:44.155741    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:39:44.248374 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:44.248340    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:44.929992 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:44.929956    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:45.808247 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:45.808211    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:46.488962 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:46.488927    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:47.154796 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:47.154749    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:47.210499 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:47.210462    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:47.612457 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:47.612366    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:47.717296 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:47.717265    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:39:47.722530 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:47.722505    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"]
Sep 15 09:39:47.726309 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:47.726291    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"
Sep 15 09:39:47.728498 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:47.728480    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-e029b0-dockercfg-l9nbv\""
Sep 15 09:39:47.728840 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:47.728825    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-e029b0\""
Sep 15 09:39:47.737715 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:47.737694    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"]
Sep 15 09:39:47.837177 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:47.837145    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkl5v\" (UniqueName: \"kubernetes.io/projected/57d99cfb-94ba-4c06-9054-f1dc1b613e58-kube-api-access-nkl5v\") pod \"payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh\" (UID: \"57d99cfb-94ba-4c06-9054-f1dc1b613e58\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"
Sep 15 09:39:47.837359 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:47.837220    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57d99cfb-94ba-4c06-9054-f1dc1b613e58-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh\" (UID: \"57d99cfb-94ba-4c06-9054-f1dc1b613e58\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"
Sep 15 09:39:47.938684 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:47.938650    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57d99cfb-94ba-4c06-9054-f1dc1b613e58-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh\" (UID: \"57d99cfb-94ba-4c06-9054-f1dc1b613e58\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"
Sep 15 09:39:47.938893 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:47.938790    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkl5v\" (UniqueName: \"kubernetes.io/projected/57d99cfb-94ba-4c06-9054-f1dc1b613e58-kube-api-access-nkl5v\") pod \"payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh\" (UID: \"57d99cfb-94ba-4c06-9054-f1dc1b613e58\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"
Sep 15 09:39:47.939418 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:47.939393    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57d99cfb-94ba-4c06-9054-f1dc1b613e58-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh\" (UID: \"57d99cfb-94ba-4c06-9054-f1dc1b613e58\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"
Sep 15 09:39:47.948418 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:47.948385    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkl5v\" (UniqueName: \"kubernetes.io/projected/57d99cfb-94ba-4c06-9054-f1dc1b613e58-kube-api-access-nkl5v\") pod \"payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh\" (UID: \"57d99cfb-94ba-4c06-9054-f1dc1b613e58\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"
Sep 15 09:39:48.037943 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:48.037911    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"
Sep 15 09:39:48.317794 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:48.317629    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"]
Sep 15 09:39:48.320695 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:39:48.320664    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d99cfb_94ba_4c06_9054_f1dc1b613e58.slice/crio-8beda520a97fb4f71c20e6a015c5d3134a6fd1480856f75613f3a660c8830f20 WatchSource:0}: Error finding container 8beda520a97fb4f71c20e6a015c5d3134a6fd1480856f75613f3a660c8830f20: Status 404 returned error can't find the container with id 8beda520a97fb4f71c20e6a015c5d3134a6fd1480856f75613f3a660c8830f20
Sep 15 09:39:49.173316 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:49.173280    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh" event={"ID":"57d99cfb-94ba-4c06-9054-f1dc1b613e58","Type":"ContainerStarted","Data":"411d709b123c54696944d6a38c0c4232afe44f0d79e50403c4b344accc68578e"}
Sep 15 09:39:49.173499 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:49.173339    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh" event={"ID":"57d99cfb-94ba-4c06-9054-f1dc1b613e58","Type":"ContainerStarted","Data":"8beda520a97fb4f71c20e6a015c5d3134a6fd1480856f75613f3a660c8830f20"}
Sep 15 09:39:49.173499 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:49.173416    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"
Sep 15 09:39:49.188742 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:39:49.188699    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh" podStartSLOduration=2.188685541 podStartE2EDuration="2.188685541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:39:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:39:49.188036589 +0000 UTC m=+1552.837452678" watchObservedRunningTime="2026-09-15 09:39:49.188685541 +0000 UTC m=+1552.838101633"
Sep 15 09:40:00.180537 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:00.180504    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"
Sep 15 09:40:09.203147 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:09.203112    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:09.904940 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:09.904903    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:10.618471 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:10.618439    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:11.250297 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:11.250254    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:11.907600 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:11.907567    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:13.779328 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:13.779293    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:14.694094 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:14.694060    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:14.868421 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:14.868390    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44"]
Sep 15 09:40:14.872190 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:14.872167    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44"
Sep 15 09:40:14.874815 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:14.874797    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:40:14.881264 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:14.881231    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44"]
Sep 15 09:40:15.001464 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:15.001373    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4574b15b-88a7-4d9f-9700-96506af18332-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44\" (UID: \"4574b15b-88a7-4d9f-9700-96506af18332\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44"
Sep 15 09:40:15.102241 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:15.102207    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4574b15b-88a7-4d9f-9700-96506af18332-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44\" (UID: \"4574b15b-88a7-4d9f-9700-96506af18332\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44"
Sep 15 09:40:15.103098 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:15.103071    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4574b15b-88a7-4d9f-9700-96506af18332-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44\" (UID: \"4574b15b-88a7-4d9f-9700-96506af18332\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44"
Sep 15 09:40:15.186078 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:15.186042    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44"
Sep 15 09:40:15.460175 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:15.460139    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44"]
Sep 15 09:40:15.461860 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:40:15.461835    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4574b15b_88a7_4d9f_9700_96506af18332.slice/crio-d7e243432a1f6a461957b6678706b84b8be1773765265d2ccb298cabf92292ca WatchSource:0}: Error finding container d7e243432a1f6a461957b6678706b84b8be1773765265d2ccb298cabf92292ca: Status 404 returned error can't find the container with id d7e243432a1f6a461957b6678706b84b8be1773765265d2ccb298cabf92292ca
Sep 15 09:40:15.628797 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:15.628746    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:16.329037 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:16.328998    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:16.332352 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:16.332325    2575 generic.go:356] "Generic (PLEG): container finished" podID="4574b15b-88a7-4d9f-9700-96506af18332" containerID="2573b33a0a45e0b048aef6e354e858fc3a01f246129ded920bb981e70c0602e8" exitCode=0
Sep 15 09:40:16.332511 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:16.332367    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44" event={"ID":"4574b15b-88a7-4d9f-9700-96506af18332","Type":"ContainerDied","Data":"2573b33a0a45e0b048aef6e354e858fc3a01f246129ded920bb981e70c0602e8"}
Sep 15 09:40:16.332511 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:16.332434    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44" event={"ID":"4574b15b-88a7-4d9f-9700-96506af18332","Type":"ContainerStarted","Data":"d7e243432a1f6a461957b6678706b84b8be1773765265d2ccb298cabf92292ca"}
Sep 15 09:40:17.237321 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:17.237291    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:17.496570 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:17.496511    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44"
Sep 15 09:40:17.631913 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:17.631883    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4574b15b-88a7-4d9f-9700-96506af18332-maas-api-service-ca\") pod \"4574b15b-88a7-4d9f-9700-96506af18332\" (UID: \"4574b15b-88a7-4d9f-9700-96506af18332\") "
Sep 15 09:40:17.632222 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:17.632199    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4574b15b-88a7-4d9f-9700-96506af18332-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4574b15b-88a7-4d9f-9700-96506af18332" (UID: "4574b15b-88a7-4d9f-9700-96506af18332"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:17.733191 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:17.733159    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4574b15b-88a7-4d9f-9700-96506af18332-maas-api-service-ca\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:40:17.953794 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:17.953709    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:18.346393 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:18.346301    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44"
Sep 15 09:40:18.346393 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:18.346344    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44" event={"ID":"4574b15b-88a7-4d9f-9700-96506af18332","Type":"ContainerDied","Data":"d7e243432a1f6a461957b6678706b84b8be1773765265d2ccb298cabf92292ca"}
Sep 15 09:40:18.346597 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:18.346394    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7e243432a1f6a461957b6678706b84b8be1773765265d2ccb298cabf92292ca"
Sep 15 09:40:18.838633 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:18.838600    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:19.519284 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:19.519238    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:20.320608 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:20.320568    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:21.124372 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:21.124338    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:22.010205 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:22.010177    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:22.660678 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:22.660642    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:25.141006 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:25.140974    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:27.403879 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:27.403846    2575 generic.go:356] "Generic (PLEG): container finished" podID="63912ac3-b78a-455c-b0bc-5a6f22b47ba4" containerID="f9ee47cce25573d5b3ddd608bc326ece82d273456b87f653f56fce46085e579b" exitCode=137
Sep 15 09:40:27.404266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:27.403928    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r" event={"ID":"63912ac3-b78a-455c-b0bc-5a6f22b47ba4","Type":"ContainerDied","Data":"f9ee47cce25573d5b3ddd608bc326ece82d273456b87f653f56fce46085e579b"}
Sep 15 09:40:27.404339 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:27.404290    2575 scope.go:117] "RemoveContainer" containerID="f9ee47cce25573d5b3ddd608bc326ece82d273456b87f653f56fce46085e579b"
Sep 15 09:40:28.411982 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:28.411952    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r" event={"ID":"63912ac3-b78a-455c-b0bc-5a6f22b47ba4","Type":"ContainerStarted","Data":"89b38f73756a064690f96ae7204ccfa6c486d2bf66f0c0ab74fbe3bccc9a5a25"}
Sep 15 09:40:28.412368 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:28.412158    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"
Sep 15 09:40:30.712406 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:30.712372    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:30.794073 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:30.794039    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:30.853462 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:30.853434    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:30.950989 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:30.950723    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:30.993684 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:30.993597    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44"]
Sep 15 09:40:30.995838 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:30.995819    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9d6bb-hwx44"]
Sep 15 09:40:31.014019 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:31.013986    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:31.359592 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:31.359501    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:31.446377 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:31.446344    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:32.101729 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:32.101695    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:32.770288 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:32.770251    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:32.860923 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:32.860883    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4574b15b-88a7-4d9f-9700-96506af18332" path="/var/lib/kubelet/pods/4574b15b-88a7-4d9f-9700-96506af18332/volumes"
Sep 15 09:40:33.545140 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:33.545100    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:34.228091 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:34.228054    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:34.929307 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:34.929275    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:36.119019 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:36.118977    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:36.541220 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:36.541185    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:37.336627 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:37.336597    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:37.390606 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:37.390573    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:37.587206 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:37.587085    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:37.916740 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:37.916696    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t"]
Sep 15 09:40:37.917220 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:37.917206    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4574b15b-88a7-4d9f-9700-96506af18332" containerName="revoke-keys"
Sep 15 09:40:37.917270 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:37.917222    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4574b15b-88a7-4d9f-9700-96506af18332" containerName="revoke-keys"
Sep 15 09:40:37.917327 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:37.917319    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4574b15b-88a7-4d9f-9700-96506af18332" containerName="revoke-keys"
Sep 15 09:40:37.921751 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:37.921735    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t"
Sep 15 09:40:37.924469 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:37.924434    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:40:37.926608 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:37.926577    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t"]
Sep 15 09:40:37.939675 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:37.939653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afff74ce-0f4c-42ba-90e9-213c638fbb02-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t\" (UID: \"afff74ce-0f4c-42ba-90e9-213c638fbb02\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t"
Sep 15 09:40:38.041383 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:38.041349    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afff74ce-0f4c-42ba-90e9-213c638fbb02-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t\" (UID: \"afff74ce-0f4c-42ba-90e9-213c638fbb02\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t"
Sep 15 09:40:38.042214 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:38.042181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afff74ce-0f4c-42ba-90e9-213c638fbb02-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t\" (UID: \"afff74ce-0f4c-42ba-90e9-213c638fbb02\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t"
Sep 15 09:40:38.234873 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:38.234787    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t"
Sep 15 09:40:38.508038 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:38.508014    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t"]
Sep 15 09:40:38.509811 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:40:38.509783    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafff74ce_0f4c_42ba_90e9_213c638fbb02.slice/crio-67d82a4593c5ee6bc85160dd32fd7d04b1a47daa88be46846dab313d37d85da2 WatchSource:0}: Error finding container 67d82a4593c5ee6bc85160dd32fd7d04b1a47daa88be46846dab313d37d85da2: Status 404 returned error can't find the container with id 67d82a4593c5ee6bc85160dd32fd7d04b1a47daa88be46846dab313d37d85da2
Sep 15 09:40:38.714597 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:38.714560    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:38.930741 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:38.930708    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:39.419442 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:39.419411    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"
Sep 15 09:40:39.483571 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:39.483541    2575 generic.go:356] "Generic (PLEG): container finished" podID="afff74ce-0f4c-42ba-90e9-213c638fbb02" containerID="1728fd44bbf028ab9a34170b3574673e19cebecd36d1b65327cb64be02477304" exitCode=0
Sep 15 09:40:39.483755 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:39.483632    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t" event={"ID":"afff74ce-0f4c-42ba-90e9-213c638fbb02","Type":"ContainerDied","Data":"1728fd44bbf028ab9a34170b3574673e19cebecd36d1b65327cb64be02477304"}
Sep 15 09:40:39.483755 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:39.483684    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t" event={"ID":"afff74ce-0f4c-42ba-90e9-213c638fbb02","Type":"ContainerStarted","Data":"67d82a4593c5ee6bc85160dd32fd7d04b1a47daa88be46846dab313d37d85da2"}
Sep 15 09:40:39.730326 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:39.730293    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:40.547923 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:40.547692    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:40.645683 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:40.645659    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t"
Sep 15 09:40:40.769175 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:40.769096    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afff74ce-0f4c-42ba-90e9-213c638fbb02-maas-api-service-ca\") pod \"afff74ce-0f4c-42ba-90e9-213c638fbb02\" (UID: \"afff74ce-0f4c-42ba-90e9-213c638fbb02\") "
Sep 15 09:40:40.769526 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:40.769419    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afff74ce-0f4c-42ba-90e9-213c638fbb02-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "afff74ce-0f4c-42ba-90e9-213c638fbb02" (UID: "afff74ce-0f4c-42ba-90e9-213c638fbb02"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:40.870155 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:40.870127    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afff74ce-0f4c-42ba-90e9-213c638fbb02-maas-api-service-ca\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:40:41.350039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:41.350009    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:41.496622 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:41.496592    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t"
Sep 15 09:40:41.496622 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:41.496620    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t" event={"ID":"afff74ce-0f4c-42ba-90e9-213c638fbb02","Type":"ContainerDied","Data":"67d82a4593c5ee6bc85160dd32fd7d04b1a47daa88be46846dab313d37d85da2"}
Sep 15 09:40:41.496848 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:41.496660    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67d82a4593c5ee6bc85160dd32fd7d04b1a47daa88be46846dab313d37d85da2"
Sep 15 09:40:42.122820 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:42.122792    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:42.763412 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:42.763382    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:43.487814 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:43.487785    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:44.140255 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:44.140196    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:53.376872 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.376795    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:53.414067 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.414037    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"]
Sep 15 09:40:53.414621 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.414315    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh" podUID="57d99cfb-94ba-4c06-9054-f1dc1b613e58" containerName="payload-pre-processing" containerID="cri-o://411d709b123c54696944d6a38c0c4232afe44f0d79e50403c4b344accc68578e" gracePeriod=30
Sep 15 09:40:53.436389 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.436362    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:53.494542 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.494515    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:53.563194 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.563124    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t"]
Sep 15 09:40:53.563527 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.563495    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:53.565670 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.565645    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e029b0-mgf7t"]
Sep 15 09:40:53.570936 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.570908    2575 generic.go:356] "Generic (PLEG): container finished" podID="57d99cfb-94ba-4c06-9054-f1dc1b613e58" containerID="411d709b123c54696944d6a38c0c4232afe44f0d79e50403c4b344accc68578e" exitCode=0
Sep 15 09:40:53.571066 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.571049    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh" event={"ID":"57d99cfb-94ba-4c06-9054-f1dc1b613e58","Type":"ContainerDied","Data":"411d709b123c54696944d6a38c0c4232afe44f0d79e50403c4b344accc68578e"}
Sep 15 09:40:53.620611 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.620574    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:53.688856 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.688830    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"
Sep 15 09:40:53.795852 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.795824    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57d99cfb-94ba-4c06-9054-f1dc1b613e58-plugins-config-volume\") pod \"57d99cfb-94ba-4c06-9054-f1dc1b613e58\" (UID: \"57d99cfb-94ba-4c06-9054-f1dc1b613e58\") "
Sep 15 09:40:53.796020 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.795885    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkl5v\" (UniqueName: \"kubernetes.io/projected/57d99cfb-94ba-4c06-9054-f1dc1b613e58-kube-api-access-nkl5v\") pod \"57d99cfb-94ba-4c06-9054-f1dc1b613e58\" (UID: \"57d99cfb-94ba-4c06-9054-f1dc1b613e58\") "
Sep 15 09:40:53.796191 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.796166    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57d99cfb-94ba-4c06-9054-f1dc1b613e58-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "57d99cfb-94ba-4c06-9054-f1dc1b613e58" (UID: "57d99cfb-94ba-4c06-9054-f1dc1b613e58"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:53.797987 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.797953    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57d99cfb-94ba-4c06-9054-f1dc1b613e58-kube-api-access-nkl5v" (OuterVolumeSpecName: "kube-api-access-nkl5v") pod "57d99cfb-94ba-4c06-9054-f1dc1b613e58" (UID: "57d99cfb-94ba-4c06-9054-f1dc1b613e58"). InnerVolumeSpecName "kube-api-access-nkl5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:40:53.896681 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.896648    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57d99cfb-94ba-4c06-9054-f1dc1b613e58-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:40:53.896681 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.896678    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkl5v\" (UniqueName: \"kubernetes.io/projected/57d99cfb-94ba-4c06-9054-f1dc1b613e58-kube-api-access-nkl5v\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:40:53.898667 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.898640    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:53.998943 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:53.998839    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:54.578271 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:54.578243    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"
Sep 15 09:40:54.578652 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:54.578271    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh" event={"ID":"57d99cfb-94ba-4c06-9054-f1dc1b613e58","Type":"ContainerDied","Data":"8beda520a97fb4f71c20e6a015c5d3134a6fd1480856f75613f3a660c8830f20"}
Sep 15 09:40:54.578652 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:54.578322    2575 scope.go:117] "RemoveContainer" containerID="411d709b123c54696944d6a38c0c4232afe44f0d79e50403c4b344accc68578e"
Sep 15 09:40:54.601911 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:54.601882    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"]
Sep 15 09:40:54.605367 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:54.605345    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e029b0-5b94b6d5f4-52ggh"]
Sep 15 09:40:54.661690 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:54.661655    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:54.859713 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:54.859621    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57d99cfb-94ba-4c06-9054-f1dc1b613e58" path="/var/lib/kubelet/pods/57d99cfb-94ba-4c06-9054-f1dc1b613e58/volumes"
Sep 15 09:40:54.860113 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:54.860091    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afff74ce-0f4c-42ba-90e9-213c638fbb02" path="/var/lib/kubelet/pods/afff74ce-0f4c-42ba-90e9-213c638fbb02/volumes"
Sep 15 09:40:55.411107 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:55.411078    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:56.015399 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:56.015362    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:56.846048 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:56.846018    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:57.700149 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:57.700118    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:58.724051 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:58.724010    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:59.306416 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:59.306366    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:40:59.361499 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:40:59.361460    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:00.130283 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:00.130249    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:00.190220 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:00.190192    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:00.387982 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:00.387949    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:00.703598 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:00.703518    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k"]
Sep 15 09:41:00.704011 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:00.703999    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57d99cfb-94ba-4c06-9054-f1dc1b613e58" containerName="payload-pre-processing"
Sep 15 09:41:00.704060 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:00.704013    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="57d99cfb-94ba-4c06-9054-f1dc1b613e58" containerName="payload-pre-processing"
Sep 15 09:41:00.704060 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:00.704040    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afff74ce-0f4c-42ba-90e9-213c638fbb02" containerName="revoke-keys"
Sep 15 09:41:00.704060 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:00.704047    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="afff74ce-0f4c-42ba-90e9-213c638fbb02" containerName="revoke-keys"
Sep 15 09:41:00.704164 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:00.704120    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="57d99cfb-94ba-4c06-9054-f1dc1b613e58" containerName="payload-pre-processing"
Sep 15 09:41:00.704164 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:00.704132    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="afff74ce-0f4c-42ba-90e9-213c638fbb02" containerName="revoke-keys"
Sep 15 09:41:00.709027 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:00.709002    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k"
Sep 15 09:41:00.711256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:00.711233    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:41:00.714056 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:00.714035    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k"]
Sep 15 09:41:00.768895 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:00.768863    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80195a9e-52f8-4ecf-853f-06206e0b58ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k\" (UID: \"80195a9e-52f8-4ecf-853f-06206e0b58ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k"
Sep 15 09:41:00.870005 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:00.869973    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80195a9e-52f8-4ecf-853f-06206e0b58ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k\" (UID: \"80195a9e-52f8-4ecf-853f-06206e0b58ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k"
Sep 15 09:41:00.870604 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:00.870581    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80195a9e-52f8-4ecf-853f-06206e0b58ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k\" (UID: \"80195a9e-52f8-4ecf-853f-06206e0b58ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k"
Sep 15 09:41:01.000464 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:01.000377    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:01.022388 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:01.022362    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k"
Sep 15 09:41:01.300899 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:01.300871    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k"]
Sep 15 09:41:01.302557 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:41:01.302513    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80195a9e_52f8_4ecf_853f_06206e0b58ca.slice/crio-4fb8066586d15f83eae941f523c931102f99b31968c0f5e86949f41c9cac8388 WatchSource:0}: Error finding container 4fb8066586d15f83eae941f523c931102f99b31968c0f5e86949f41c9cac8388: Status 404 returned error can't find the container with id 4fb8066586d15f83eae941f523c931102f99b31968c0f5e86949f41c9cac8388
Sep 15 09:41:01.620447 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:01.620412    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k" event={"ID":"80195a9e-52f8-4ecf-853f-06206e0b58ca","Type":"ContainerStarted","Data":"4fb8066586d15f83eae941f523c931102f99b31968c0f5e86949f41c9cac8388"}
Sep 15 09:41:01.811855 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:01.811751    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:02.629418 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:02.629318    2575 generic.go:356] "Generic (PLEG): container finished" podID="80195a9e-52f8-4ecf-853f-06206e0b58ca" containerID="24062eb927cbb225c775001c2516e4c630786f304182071fbdcc51cda3fb8380" exitCode=0
Sep 15 09:41:02.629805 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:02.629421    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k" event={"ID":"80195a9e-52f8-4ecf-853f-06206e0b58ca","Type":"ContainerDied","Data":"24062eb927cbb225c775001c2516e4c630786f304182071fbdcc51cda3fb8380"}
Sep 15 09:41:02.630717 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:02.630696    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:03.312723 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:03.312682    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:03.800876 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:03.800848    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k"
Sep 15 09:41:03.900247 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:03.900221    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80195a9e-52f8-4ecf-853f-06206e0b58ca-maas-api-service-ca\") pod \"80195a9e-52f8-4ecf-853f-06206e0b58ca\" (UID: \"80195a9e-52f8-4ecf-853f-06206e0b58ca\") "
Sep 15 09:41:03.900563 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:03.900538    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80195a9e-52f8-4ecf-853f-06206e0b58ca-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "80195a9e-52f8-4ecf-853f-06206e0b58ca" (UID: "80195a9e-52f8-4ecf-853f-06206e0b58ca"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:41:03.963267 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:03.963234    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:04.001383 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:04.001354    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80195a9e-52f8-4ecf-853f-06206e0b58ca-maas-api-service-ca\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:04.641773 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:04.641743    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k"
Sep 15 09:41:04.641992 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:04.641746    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k" event={"ID":"80195a9e-52f8-4ecf-853f-06206e0b58ca","Type":"ContainerDied","Data":"4fb8066586d15f83eae941f523c931102f99b31968c0f5e86949f41c9cac8388"}
Sep 15 09:41:04.641992 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:04.641926    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4fb8066586d15f83eae941f523c931102f99b31968c0f5e86949f41c9cac8388"
Sep 15 09:41:04.674543 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:04.674510    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:05.423915 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:05.423884    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:06.247659 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:06.247628    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:11.161275 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.161246    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:11.190545 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.190515    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"]
Sep 15 09:41:11.190796 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.190752    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz" podUID="ac759898-f93c-4b80-bd0e-93c498f7b827" containerName="payload-processing" containerID="cri-o://2ab96ec7ebda0ea352f740f02d2422f02822b68c62436b721700eea5772b8abe" gracePeriod=30
Sep 15 09:41:11.262798 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.262234    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:11.359119 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.359080    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k"]
Sep 15 09:41:11.363508 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.363448    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-f514a4-pwm2k"]
Sep 15 09:41:11.365413 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.365384    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:11.421322 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.421109    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:11.456623 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.456598    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"
Sep 15 09:41:11.575090 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.575057    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac759898-f93c-4b80-bd0e-93c498f7b827-plugins-config-volume\") pod \"ac759898-f93c-4b80-bd0e-93c498f7b827\" (UID: \"ac759898-f93c-4b80-bd0e-93c498f7b827\") "
Sep 15 09:41:11.575281 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.575194    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bn85\" (UniqueName: \"kubernetes.io/projected/ac759898-f93c-4b80-bd0e-93c498f7b827-kube-api-access-5bn85\") pod \"ac759898-f93c-4b80-bd0e-93c498f7b827\" (UID: \"ac759898-f93c-4b80-bd0e-93c498f7b827\") "
Sep 15 09:41:11.575488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.575465    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac759898-f93c-4b80-bd0e-93c498f7b827-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ac759898-f93c-4b80-bd0e-93c498f7b827" (UID: "ac759898-f93c-4b80-bd0e-93c498f7b827"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:41:11.577442 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.577419    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac759898-f93c-4b80-bd0e-93c498f7b827-kube-api-access-5bn85" (OuterVolumeSpecName: "kube-api-access-5bn85") pod "ac759898-f93c-4b80-bd0e-93c498f7b827" (UID: "ac759898-f93c-4b80-bd0e-93c498f7b827"). InnerVolumeSpecName "kube-api-access-5bn85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:11.676499 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.676393    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bn85\" (UniqueName: \"kubernetes.io/projected/ac759898-f93c-4b80-bd0e-93c498f7b827-kube-api-access-5bn85\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:11.676499 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.676429    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac759898-f93c-4b80-bd0e-93c498f7b827-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:11.686307 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.686268    2575 generic.go:356] "Generic (PLEG): container finished" podID="ac759898-f93c-4b80-bd0e-93c498f7b827" containerID="2ab96ec7ebda0ea352f740f02d2422f02822b68c62436b721700eea5772b8abe" exitCode=0
Sep 15 09:41:11.686496 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.686324    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"
Sep 15 09:41:11.686496 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.686327    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz" event={"ID":"ac759898-f93c-4b80-bd0e-93c498f7b827","Type":"ContainerDied","Data":"2ab96ec7ebda0ea352f740f02d2422f02822b68c62436b721700eea5772b8abe"}
Sep 15 09:41:11.686496 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.686399    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz" event={"ID":"ac759898-f93c-4b80-bd0e-93c498f7b827","Type":"ContainerDied","Data":"4f49d677c4142d97d91d0196c7bcdc99ea315ff1b5a0dfcb167fbfc89c2226c0"}
Sep 15 09:41:11.686496 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.686435    2575 scope.go:117] "RemoveContainer" containerID="2ab96ec7ebda0ea352f740f02d2422f02822b68c62436b721700eea5772b8abe"
Sep 15 09:41:11.700448 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.700421    2575 scope.go:117] "RemoveContainer" containerID="2ab96ec7ebda0ea352f740f02d2422f02822b68c62436b721700eea5772b8abe"
Sep 15 09:41:11.700882 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:41:11.700853    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ab96ec7ebda0ea352f740f02d2422f02822b68c62436b721700eea5772b8abe\": container with ID starting with 2ab96ec7ebda0ea352f740f02d2422f02822b68c62436b721700eea5772b8abe not found: ID does not exist" containerID="2ab96ec7ebda0ea352f740f02d2422f02822b68c62436b721700eea5772b8abe"
Sep 15 09:41:11.701005 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.700894    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ab96ec7ebda0ea352f740f02d2422f02822b68c62436b721700eea5772b8abe"} err="failed to get container status \"2ab96ec7ebda0ea352f740f02d2422f02822b68c62436b721700eea5772b8abe\": rpc error: code = NotFound desc = could not find container \"2ab96ec7ebda0ea352f740f02d2422f02822b68c62436b721700eea5772b8abe\": container with ID starting with 2ab96ec7ebda0ea352f740f02d2422f02822b68c62436b721700eea5772b8abe not found: ID does not exist"
Sep 15 09:41:11.713197 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.713166    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"]
Sep 15 09:41:11.718065 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.718040    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f514a4-79c469bb95-vm6rz"]
Sep 15 09:41:11.720129 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.720105    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:11.831262 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:11.831225    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:12.706558 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:12.706524    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:12.860752 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:12.860715    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80195a9e-52f8-4ecf-853f-06206e0b58ca" path="/var/lib/kubelet/pods/80195a9e-52f8-4ecf-853f-06206e0b58ca/volumes"
Sep 15 09:41:12.861126 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:12.861110    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac759898-f93c-4b80-bd0e-93c498f7b827" path="/var/lib/kubelet/pods/ac759898-f93c-4b80-bd0e-93c498f7b827/volumes"
Sep 15 09:41:13.502019 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:13.501967    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:14.342024 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:14.341984    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:14.860078 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:14.860039    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:15.529620 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:15.529589    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:17.173719 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.173690    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:17.272183 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.272147    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc"]
Sep 15 09:41:17.272615 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.272603    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80195a9e-52f8-4ecf-853f-06206e0b58ca" containerName="revoke-keys"
Sep 15 09:41:17.272680 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.272617    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="80195a9e-52f8-4ecf-853f-06206e0b58ca" containerName="revoke-keys"
Sep 15 09:41:17.272680 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.272631    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac759898-f93c-4b80-bd0e-93c498f7b827" containerName="payload-processing"
Sep 15 09:41:17.272680 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.272636    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac759898-f93c-4b80-bd0e-93c498f7b827" containerName="payload-processing"
Sep 15 09:41:17.272839 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.272713    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac759898-f93c-4b80-bd0e-93c498f7b827" containerName="payload-processing"
Sep 15 09:41:17.272839 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.272726    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="80195a9e-52f8-4ecf-853f-06206e0b58ca" containerName="revoke-keys"
Sep 15 09:41:17.277236 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.277208    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc"
Sep 15 09:41:17.279460 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.279438    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:41:17.284113 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.284086    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc"]
Sep 15 09:41:17.333420 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.333392    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d7604e5-435f-4fe2-8c07-5584bc629786-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc\" (UID: \"6d7604e5-435f-4fe2-8c07-5584bc629786\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc"
Sep 15 09:41:17.435077 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.434972    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d7604e5-435f-4fe2-8c07-5584bc629786-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc\" (UID: \"6d7604e5-435f-4fe2-8c07-5584bc629786\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc"
Sep 15 09:41:17.435564 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.435546    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d7604e5-435f-4fe2-8c07-5584bc629786-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc\" (UID: \"6d7604e5-435f-4fe2-8c07-5584bc629786\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc"
Sep 15 09:41:17.539708 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.539679    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:17.592657 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.592625    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc"
Sep 15 09:41:17.772593 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.772495    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:17.870731 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.870708    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc"]
Sep 15 09:41:17.871210 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.871178    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:17.873500 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:41:17.873477    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7604e5_435f_4fe2_8c07_5584bc629786.slice/crio-5997363ace0bf0beedac7979ae10dbbd12da7fa46b9870427fd4881174966c4f WatchSource:0}: Error finding container 5997363ace0bf0beedac7979ae10dbbd12da7fa46b9870427fd4881174966c4f: Status 404 returned error can't find the container with id 5997363ace0bf0beedac7979ae10dbbd12da7fa46b9870427fd4881174966c4f
Sep 15 09:41:17.918906 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.918877    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"]
Sep 15 09:41:17.919103 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.919072    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7" podUID="01c903f2-8a23-400f-936d-e50f0e4e9dc1" containerName="istio-proxy" containerID="cri-o://24a3e33c3bc5b641cf9dc6c71612005a03c0d25fd5952230bc450225dd0cdad9" gracePeriod=30
Sep 15 09:41:17.954045 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:17.949441    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:18.630640 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:18.630592    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:18.739111 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:18.739074    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc" event={"ID":"6d7604e5-435f-4fe2-8c07-5584bc629786","Type":"ContainerStarted","Data":"c9fc3ad213259daa667b5c68a6f6013d643962af4ded9c481240abfa596f69ea"}
Sep 15 09:41:18.739287 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:18.739174    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc" event={"ID":"6d7604e5-435f-4fe2-8c07-5584bc629786","Type":"ContainerStarted","Data":"5997363ace0bf0beedac7979ae10dbbd12da7fa46b9870427fd4881174966c4f"}
Sep 15 09:41:18.755857 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:18.755813    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc" podStartSLOduration=1.7557545509999999 podStartE2EDuration="1.755754551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:41:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:41:18.753599951 +0000 UTC m=+1642.403016045" watchObservedRunningTime="2026-09-15 09:41:18.755754551 +0000 UTC m=+1642.405170670"
Sep 15 09:41:19.293403 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:19.293367    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 09:41:19.293577 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:19.293424    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7" podUID="01c903f2-8a23-400f-936d-e50f0e4e9dc1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 09:41:19.334524 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:19.334488    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:19.748449 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:19.748420    2575 generic.go:356] "Generic (PLEG): container finished" podID="6d7604e5-435f-4fe2-8c07-5584bc629786" containerID="c9fc3ad213259daa667b5c68a6f6013d643962af4ded9c481240abfa596f69ea" exitCode=0
Sep 15 09:41:19.748856 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:19.748510    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc" event={"ID":"6d7604e5-435f-4fe2-8c07-5584bc629786","Type":"ContainerDied","Data":"c9fc3ad213259daa667b5c68a6f6013d643962af4ded9c481240abfa596f69ea"}
Sep 15 09:41:19.993781 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:19.993739    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:20.653432 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:20.653400    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:20.917218 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:20.917150    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc"
Sep 15 09:41:20.973574 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:20.973548    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d7604e5-435f-4fe2-8c07-5584bc629786-maas-api-service-ca\") pod \"6d7604e5-435f-4fe2-8c07-5584bc629786\" (UID: \"6d7604e5-435f-4fe2-8c07-5584bc629786\") "
Sep 15 09:41:20.973986 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:20.973968    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d7604e5-435f-4fe2-8c07-5584bc629786-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6d7604e5-435f-4fe2-8c07-5584bc629786" (UID: "6d7604e5-435f-4fe2-8c07-5584bc629786"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:41:21.074667 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:21.074636    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d7604e5-435f-4fe2-8c07-5584bc629786-maas-api-service-ca\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:21.434079 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:21.434042    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:21.761960 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:21.761870    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc"
Sep 15 09:41:21.761960 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:21.761927    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc" event={"ID":"6d7604e5-435f-4fe2-8c07-5584bc629786","Type":"ContainerDied","Data":"5997363ace0bf0beedac7979ae10dbbd12da7fa46b9870427fd4881174966c4f"}
Sep 15 09:41:21.762145 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:21.761979    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5997363ace0bf0beedac7979ae10dbbd12da7fa46b9870427fd4881174966c4f"
Sep 15 09:41:22.177946 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:22.177916    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"]
Sep 15 09:41:22.196946 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:22.196915    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:22.212198 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:22.212156    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"]
Sep 15 09:41:22.374111 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:22.374071    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:22.919957 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:22.919926    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:23.094304 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.093865    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:23.187178 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.187118    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:41:23.297156 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.297119    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-envoy\") pod \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") "
Sep 15 09:41:23.297341 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.297200    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-token\") pod \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") "
Sep 15 09:41:23.297341 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.297248    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istiod-ca-cert\") pod \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") "
Sep 15 09:41:23.297341 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.297308    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-credential-socket\") pod \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") "
Sep 15 09:41:23.297341 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.297338    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-workload-certs\") pod \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") "
Sep 15 09:41:23.297556 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.297394    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp7xx\" (UniqueName: \"kubernetes.io/projected/01c903f2-8a23-400f-936d-e50f0e4e9dc1-kube-api-access-zp7xx\") pod \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") "
Sep 15 09:41:23.297556 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.297451    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-podinfo\") pod \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") "
Sep 15 09:41:23.297556 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.297478    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-workload-socket\") pod \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") "
Sep 15 09:41:23.297556 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.297523    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-data\") pod \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\" (UID: \"01c903f2-8a23-400f-936d-e50f0e4e9dc1\") "
Sep 15 09:41:23.297814 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.297595    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "01c903f2-8a23-400f-936d-e50f0e4e9dc1" (UID: "01c903f2-8a23-400f-936d-e50f0e4e9dc1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:23.297814 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.297666    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "01c903f2-8a23-400f-936d-e50f0e4e9dc1" (UID: "01c903f2-8a23-400f-936d-e50f0e4e9dc1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:41:23.297954 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.297871    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "01c903f2-8a23-400f-936d-e50f0e4e9dc1" (UID: "01c903f2-8a23-400f-936d-e50f0e4e9dc1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:23.297954 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.297909    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istiod-ca-cert\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:23.297954 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.297932    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-credential-socket\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:23.298193 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.298169    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-data" (OuterVolumeSpecName: "istio-data") pod "01c903f2-8a23-400f-936d-e50f0e4e9dc1" (UID: "01c903f2-8a23-400f-936d-e50f0e4e9dc1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:23.298254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.298184    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "01c903f2-8a23-400f-936d-e50f0e4e9dc1" (UID: "01c903f2-8a23-400f-936d-e50f0e4e9dc1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:23.299670 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.299646    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-token" (OuterVolumeSpecName: "istio-token") pod "01c903f2-8a23-400f-936d-e50f0e4e9dc1" (UID: "01c903f2-8a23-400f-936d-e50f0e4e9dc1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:23.300086 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.300063    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "01c903f2-8a23-400f-936d-e50f0e4e9dc1" (UID: "01c903f2-8a23-400f-936d-e50f0e4e9dc1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:41:23.300242 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.300217    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "01c903f2-8a23-400f-936d-e50f0e4e9dc1" (UID: "01c903f2-8a23-400f-936d-e50f0e4e9dc1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:23.300336 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.300264    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01c903f2-8a23-400f-936d-e50f0e4e9dc1-kube-api-access-zp7xx" (OuterVolumeSpecName: "kube-api-access-zp7xx") pod "01c903f2-8a23-400f-936d-e50f0e4e9dc1" (UID: "01c903f2-8a23-400f-936d-e50f0e4e9dc1"). InnerVolumeSpecName "kube-api-access-zp7xx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:23.399173 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.399142    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-podinfo\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:23.399173 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.399169    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-workload-socket\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:23.399173 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.399178    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-data\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:23.399396 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.399187    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-envoy\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:23.399396 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.399194    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01c903f2-8a23-400f-936d-e50f0e4e9dc1-istio-token\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:23.399396 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.399202    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01c903f2-8a23-400f-936d-e50f0e4e9dc1-workload-certs\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:23.399396 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.399209    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp7xx\" (UniqueName: \"kubernetes.io/projected/01c903f2-8a23-400f-936d-e50f0e4e9dc1-kube-api-access-zp7xx\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:23.776422 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.776385    2575 generic.go:356] "Generic (PLEG): container finished" podID="01c903f2-8a23-400f-936d-e50f0e4e9dc1" containerID="24a3e33c3bc5b641cf9dc6c71612005a03c0d25fd5952230bc450225dd0cdad9" exitCode=0
Sep 15 09:41:23.776594 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.776435    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"
Sep 15 09:41:23.776594 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.776441    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7" event={"ID":"01c903f2-8a23-400f-936d-e50f0e4e9dc1","Type":"ContainerDied","Data":"24a3e33c3bc5b641cf9dc6c71612005a03c0d25fd5952230bc450225dd0cdad9"}
Sep 15 09:41:23.776594 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.776493    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7" event={"ID":"01c903f2-8a23-400f-936d-e50f0e4e9dc1","Type":"ContainerDied","Data":"de64de653a0f03f9b5e1d163594b1c2d3b8d0b015186b144620166078116a096"}
Sep 15 09:41:23.776594 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.776517    2575 scope.go:117] "RemoveContainer" containerID="24a3e33c3bc5b641cf9dc6c71612005a03c0d25fd5952230bc450225dd0cdad9"
Sep 15 09:41:23.788113 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.788095    2575 scope.go:117] "RemoveContainer" containerID="18d953f9ce28a5a9bcf7b28241c8e5a66a5940d8fcb550c5fec73c886bd1fd00"
Sep 15 09:41:23.797495 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.797475    2575 scope.go:117] "RemoveContainer" containerID="24a3e33c3bc5b641cf9dc6c71612005a03c0d25fd5952230bc450225dd0cdad9"
Sep 15 09:41:23.797852 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:41:23.797829    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24a3e33c3bc5b641cf9dc6c71612005a03c0d25fd5952230bc450225dd0cdad9\": container with ID starting with 24a3e33c3bc5b641cf9dc6c71612005a03c0d25fd5952230bc450225dd0cdad9 not found: ID does not exist" containerID="24a3e33c3bc5b641cf9dc6c71612005a03c0d25fd5952230bc450225dd0cdad9"
Sep 15 09:41:23.797941 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.797861    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24a3e33c3bc5b641cf9dc6c71612005a03c0d25fd5952230bc450225dd0cdad9"} err="failed to get container status \"24a3e33c3bc5b641cf9dc6c71612005a03c0d25fd5952230bc450225dd0cdad9\": rpc error: code = NotFound desc = could not find container \"24a3e33c3bc5b641cf9dc6c71612005a03c0d25fd5952230bc450225dd0cdad9\": container with ID starting with 24a3e33c3bc5b641cf9dc6c71612005a03c0d25fd5952230bc450225dd0cdad9 not found: ID does not exist"
Sep 15 09:41:23.797941 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.797878    2575 scope.go:117] "RemoveContainer" containerID="18d953f9ce28a5a9bcf7b28241c8e5a66a5940d8fcb550c5fec73c886bd1fd00"
Sep 15 09:41:23.798209 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:41:23.798186    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18d953f9ce28a5a9bcf7b28241c8e5a66a5940d8fcb550c5fec73c886bd1fd00\": container with ID starting with 18d953f9ce28a5a9bcf7b28241c8e5a66a5940d8fcb550c5fec73c886bd1fd00 not found: ID does not exist" containerID="18d953f9ce28a5a9bcf7b28241c8e5a66a5940d8fcb550c5fec73c886bd1fd00"
Sep 15 09:41:23.798483 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.798214    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18d953f9ce28a5a9bcf7b28241c8e5a66a5940d8fcb550c5fec73c886bd1fd00"} err="failed to get container status \"18d953f9ce28a5a9bcf7b28241c8e5a66a5940d8fcb550c5fec73c886bd1fd00\": rpc error: code = NotFound desc = could not find container \"18d953f9ce28a5a9bcf7b28241c8e5a66a5940d8fcb550c5fec73c886bd1fd00\": container with ID starting with 18d953f9ce28a5a9bcf7b28241c8e5a66a5940d8fcb550c5fec73c886bd1fd00 not found: ID does not exist"
Sep 15 09:41:23.799528 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.799504    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"]
Sep 15 09:41:23.801887 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:23.801863    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f514a4-openshift-default-79cbbc676d-c5rp7"]
Sep 15 09:41:24.859572 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:24.859541    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01c903f2-8a23-400f-936d-e50f0e4e9dc1" path="/var/lib/kubelet/pods/01c903f2-8a23-400f-936d-e50f0e4e9dc1/volumes"
Sep 15 09:41:27.446306 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:27.446263    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:28.525804 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:28.525716    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:29.167346 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:29.167320    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:29.236252 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:29.236219    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:29.289781 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:29.289742    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:29.364139 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:29.364109    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:29.421515 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:29.421425    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:29.707444 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:29.707362    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:29.789172 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:29.789136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:30.474267 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.474226    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e76bac-29824410-z6l44"]
Sep 15 09:41:30.476290 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.476262    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e76bac-29824410-z6l44"]
Sep 15 09:41:30.494607 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.494579    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"]
Sep 15 09:41:30.495035 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.494841    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch" podUID="24d4fdc1-5c00-4e07-88be-d2ca578321f1" containerName="payload-processing" containerID="cri-o://9bf34d31dee6d74f9c42ce4ee565e236fd1cb1844329f773ccd0201b32fb8955" gracePeriod=30
Sep 15 09:41:30.509465 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.509439    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"]
Sep 15 09:41:30.509704 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.509682    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx" podUID="fb3ffae6-5cd7-4649-89e0-5f673dc96366" containerName="payload-pre-processing" containerID="cri-o://e9b7f6988a825b5c5365b0a5f5442469227f2fd564c65b30971c8da031115ea4" gracePeriod=30
Sep 15 09:41:30.537561 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.537535    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:30.637276 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.637250    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:30.675949 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.675911    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc"]
Sep 15 09:41:30.678749 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.678719    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e76bac-hhzwc"]
Sep 15 09:41:30.749726 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.749621    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:30.800176 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.800139    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"
Sep 15 09:41:30.818890 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.818542    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"
Sep 15 09:41:30.818890 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.818727    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:30.824269 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.824241    2575 generic.go:356] "Generic (PLEG): container finished" podID="fb3ffae6-5cd7-4649-89e0-5f673dc96366" containerID="e9b7f6988a825b5c5365b0a5f5442469227f2fd564c65b30971c8da031115ea4" exitCode=0
Sep 15 09:41:30.824412 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.824306    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"
Sep 15 09:41:30.824412 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.824331    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx" event={"ID":"fb3ffae6-5cd7-4649-89e0-5f673dc96366","Type":"ContainerDied","Data":"e9b7f6988a825b5c5365b0a5f5442469227f2fd564c65b30971c8da031115ea4"}
Sep 15 09:41:30.824412 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.824385    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx" event={"ID":"fb3ffae6-5cd7-4649-89e0-5f673dc96366","Type":"ContainerDied","Data":"b66aa61418b9f9b85ec26f2de5f1ec59ceb068fc17e14c7eb9846b134e28fa35"}
Sep 15 09:41:30.824590 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.824417    2575 scope.go:117] "RemoveContainer" containerID="e9b7f6988a825b5c5365b0a5f5442469227f2fd564c65b30971c8da031115ea4"
Sep 15 09:41:30.826363 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.826337    2575 generic.go:356] "Generic (PLEG): container finished" podID="24d4fdc1-5c00-4e07-88be-d2ca578321f1" containerID="9bf34d31dee6d74f9c42ce4ee565e236fd1cb1844329f773ccd0201b32fb8955" exitCode=0
Sep 15 09:41:30.826477 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.826379    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"
Sep 15 09:41:30.826477 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.826418    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch" event={"ID":"24d4fdc1-5c00-4e07-88be-d2ca578321f1","Type":"ContainerDied","Data":"9bf34d31dee6d74f9c42ce4ee565e236fd1cb1844329f773ccd0201b32fb8955"}
Sep 15 09:41:30.826477 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.826460    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch" event={"ID":"24d4fdc1-5c00-4e07-88be-d2ca578321f1","Type":"ContainerDied","Data":"ed034ac88862ef5f5747a043c480b6f5a863068575b83ada0d88212a1d44e40d"}
Sep 15 09:41:30.834232 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.834166    2575 scope.go:117] "RemoveContainer" containerID="e9b7f6988a825b5c5365b0a5f5442469227f2fd564c65b30971c8da031115ea4"
Sep 15 09:41:30.834483 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:41:30.834457    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9b7f6988a825b5c5365b0a5f5442469227f2fd564c65b30971c8da031115ea4\": container with ID starting with e9b7f6988a825b5c5365b0a5f5442469227f2fd564c65b30971c8da031115ea4 not found: ID does not exist" containerID="e9b7f6988a825b5c5365b0a5f5442469227f2fd564c65b30971c8da031115ea4"
Sep 15 09:41:30.834563 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.834494    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9b7f6988a825b5c5365b0a5f5442469227f2fd564c65b30971c8da031115ea4"} err="failed to get container status \"e9b7f6988a825b5c5365b0a5f5442469227f2fd564c65b30971c8da031115ea4\": rpc error: code = NotFound desc = could not find container \"e9b7f6988a825b5c5365b0a5f5442469227f2fd564c65b30971c8da031115ea4\": container with ID starting with e9b7f6988a825b5c5365b0a5f5442469227f2fd564c65b30971c8da031115ea4 not found: ID does not exist"
Sep 15 09:41:30.834563 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.834515    2575 scope.go:117] "RemoveContainer" containerID="9bf34d31dee6d74f9c42ce4ee565e236fd1cb1844329f773ccd0201b32fb8955"
Sep 15 09:41:30.848268 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.848248    2575 scope.go:117] "RemoveContainer" containerID="9bf34d31dee6d74f9c42ce4ee565e236fd1cb1844329f773ccd0201b32fb8955"
Sep 15 09:41:30.849186 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:41:30.848786    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bf34d31dee6d74f9c42ce4ee565e236fd1cb1844329f773ccd0201b32fb8955\": container with ID starting with 9bf34d31dee6d74f9c42ce4ee565e236fd1cb1844329f773ccd0201b32fb8955 not found: ID does not exist" containerID="9bf34d31dee6d74f9c42ce4ee565e236fd1cb1844329f773ccd0201b32fb8955"
Sep 15 09:41:30.849186 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.848823    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bf34d31dee6d74f9c42ce4ee565e236fd1cb1844329f773ccd0201b32fb8955"} err="failed to get container status \"9bf34d31dee6d74f9c42ce4ee565e236fd1cb1844329f773ccd0201b32fb8955\": rpc error: code = NotFound desc = could not find container \"9bf34d31dee6d74f9c42ce4ee565e236fd1cb1844329f773ccd0201b32fb8955\": container with ID starting with 9bf34d31dee6d74f9c42ce4ee565e236fd1cb1844329f773ccd0201b32fb8955 not found: ID does not exist"
Sep 15 09:41:30.862045 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.861836    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d7604e5-435f-4fe2-8c07-5584bc629786" path="/var/lib/kubelet/pods/6d7604e5-435f-4fe2-8c07-5584bc629786/volumes"
Sep 15 09:41:30.862274 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.862252    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7e05da4-889e-49a1-9bc5-9d72c7e344d4" path="/var/lib/kubelet/pods/a7e05da4-889e-49a1-9bc5-9d72c7e344d4/volumes"
Sep 15 09:41:30.878664 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.878640    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlhzq\" (UniqueName: \"kubernetes.io/projected/24d4fdc1-5c00-4e07-88be-d2ca578321f1-kube-api-access-tlhzq\") pod \"24d4fdc1-5c00-4e07-88be-d2ca578321f1\" (UID: \"24d4fdc1-5c00-4e07-88be-d2ca578321f1\") "
Sep 15 09:41:30.878845 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.878675    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc47t\" (UniqueName: \"kubernetes.io/projected/fb3ffae6-5cd7-4649-89e0-5f673dc96366-kube-api-access-jc47t\") pod \"fb3ffae6-5cd7-4649-89e0-5f673dc96366\" (UID: \"fb3ffae6-5cd7-4649-89e0-5f673dc96366\") "
Sep 15 09:41:30.878930 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.878859    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb3ffae6-5cd7-4649-89e0-5f673dc96366-plugins-config-volume\") pod \"fb3ffae6-5cd7-4649-89e0-5f673dc96366\" (UID: \"fb3ffae6-5cd7-4649-89e0-5f673dc96366\") "
Sep 15 09:41:30.878930 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.878907    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24d4fdc1-5c00-4e07-88be-d2ca578321f1-plugins-config-volume\") pod \"24d4fdc1-5c00-4e07-88be-d2ca578321f1\" (UID: \"24d4fdc1-5c00-4e07-88be-d2ca578321f1\") "
Sep 15 09:41:30.879244 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.879219    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb3ffae6-5cd7-4649-89e0-5f673dc96366-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fb3ffae6-5cd7-4649-89e0-5f673dc96366" (UID: "fb3ffae6-5cd7-4649-89e0-5f673dc96366"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:41:30.879525 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.879502    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24d4fdc1-5c00-4e07-88be-d2ca578321f1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "24d4fdc1-5c00-4e07-88be-d2ca578321f1" (UID: "24d4fdc1-5c00-4e07-88be-d2ca578321f1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:41:30.880942 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.880926    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb3ffae6-5cd7-4649-89e0-5f673dc96366-kube-api-access-jc47t" (OuterVolumeSpecName: "kube-api-access-jc47t") pod "fb3ffae6-5cd7-4649-89e0-5f673dc96366" (UID: "fb3ffae6-5cd7-4649-89e0-5f673dc96366"). InnerVolumeSpecName "kube-api-access-jc47t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:30.881015 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.880951    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24d4fdc1-5c00-4e07-88be-d2ca578321f1-kube-api-access-tlhzq" (OuterVolumeSpecName: "kube-api-access-tlhzq") pod "24d4fdc1-5c00-4e07-88be-d2ca578321f1" (UID: "24d4fdc1-5c00-4e07-88be-d2ca578321f1"). InnerVolumeSpecName "kube-api-access-tlhzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:30.980293 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.980210    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24d4fdc1-5c00-4e07-88be-d2ca578321f1-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:30.980293 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.980235    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlhzq\" (UniqueName: \"kubernetes.io/projected/24d4fdc1-5c00-4e07-88be-d2ca578321f1-kube-api-access-tlhzq\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:30.980293 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.980246    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc47t\" (UniqueName: \"kubernetes.io/projected/fb3ffae6-5cd7-4649-89e0-5f673dc96366-kube-api-access-jc47t\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:30.980293 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:30.980255    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb3ffae6-5cd7-4649-89e0-5f673dc96366-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:31.019070 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:31.019042    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:31.146835 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:31.146805    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"]
Sep 15 09:41:31.151951 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:31.151915    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e76bac-69db75f45d-tqblx"]
Sep 15 09:41:31.160426 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:31.160392    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"]
Sep 15 09:41:31.163957 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:31.163925    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e76bac-5d977445c5-lwvch"]
Sep 15 09:41:31.694320 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:31.694274    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:32.463673 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:32.463637    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:32.859424 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:32.859350    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24d4fdc1-5c00-4e07-88be-d2ca578321f1" path="/var/lib/kubelet/pods/24d4fdc1-5c00-4e07-88be-d2ca578321f1/volumes"
Sep 15 09:41:32.859721 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:32.859706    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb3ffae6-5cd7-4649-89e0-5f673dc96366" path="/var/lib/kubelet/pods/fb3ffae6-5cd7-4649-89e0-5f673dc96366/volumes"
Sep 15 09:41:33.137741 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:33.137720    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:34.009774 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:34.009728    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:35.404377 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:35.404320    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:35.505559 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:35.505528    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:35.662879 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:35.662800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:37.198229 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.198185    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp" podUID="952ee430-3394-49f5-9764-a30c91dbb1fe" containerName="main" containerID="cri-o://abcb91d219c51126ca5d568d466d6e400253096d43b9fb07bd9e6a6bc50090a2" gracePeriod=45
Sep 15 09:41:37.231846 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.231812    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw" podUID="b78f5411-3e51-4455-91cd-62fdc94add9a" containerName="main" containerID="cri-o://cf0eabb28d6bd49c23ff338338a79a37c49ab233f25f075088da744a560864d5" gracePeriod=45
Sep 15 09:41:37.237937 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.237914    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:37.338449 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.338316    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:37.487853 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.487828    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"]
Sep 15 09:41:37.488274 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.488241    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh" podUID="6afb041d-1884-4e0b-ac8c-8e14813068c2" containerName="istio-proxy" containerID="cri-o://782a9b77ca7e62a1bc095c9990aad652b335d4cff708f451905f36d8dcb36767" gracePeriod=30
Sep 15 09:41:37.502282 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.502260    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:41:37.509356 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.509332    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:37.540001 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.539971    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:41:37.646141 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.646099    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-tmp-dir\") pod \"b78f5411-3e51-4455-91cd-62fdc94add9a\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") "
Sep 15 09:41:37.646322 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.646189    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-model-cache\") pod \"952ee430-3394-49f5-9764-a30c91dbb1fe\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") "
Sep 15 09:41:37.646322 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.646251    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-dshm\") pod \"952ee430-3394-49f5-9764-a30c91dbb1fe\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") "
Sep 15 09:41:37.646322 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.646283    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xr4h\" (UniqueName: \"kubernetes.io/projected/b78f5411-3e51-4455-91cd-62fdc94add9a-kube-api-access-7xr4h\") pod \"b78f5411-3e51-4455-91cd-62fdc94add9a\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") "
Sep 15 09:41:37.646322 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.646321    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b78f5411-3e51-4455-91cd-62fdc94add9a-tls-certs\") pod \"b78f5411-3e51-4455-91cd-62fdc94add9a\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") "
Sep 15 09:41:37.646560 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.646366    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-home\") pod \"b78f5411-3e51-4455-91cd-62fdc94add9a\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") "
Sep 15 09:41:37.646560 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.646394    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/952ee430-3394-49f5-9764-a30c91dbb1fe-tls-certs\") pod \"952ee430-3394-49f5-9764-a30c91dbb1fe\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") "
Sep 15 09:41:37.646560 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.646417    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-tmp-dir\") pod \"952ee430-3394-49f5-9764-a30c91dbb1fe\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") "
Sep 15 09:41:37.646560 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.646445    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b78f5411-3e51-4455-91cd-62fdc94add9a" (UID: "b78f5411-3e51-4455-91cd-62fdc94add9a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:37.646560 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.646459    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-home\") pod \"952ee430-3394-49f5-9764-a30c91dbb1fe\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") "
Sep 15 09:41:37.646560 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.646489    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-model-cache" (OuterVolumeSpecName: "model-cache") pod "952ee430-3394-49f5-9764-a30c91dbb1fe" (UID: "952ee430-3394-49f5-9764-a30c91dbb1fe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:37.646560 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.646532    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-dshm\") pod \"b78f5411-3e51-4455-91cd-62fdc94add9a\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") "
Sep 15 09:41:37.646915 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.646568    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5t6q\" (UniqueName: \"kubernetes.io/projected/952ee430-3394-49f5-9764-a30c91dbb1fe-kube-api-access-v5t6q\") pod \"952ee430-3394-49f5-9764-a30c91dbb1fe\" (UID: \"952ee430-3394-49f5-9764-a30c91dbb1fe\") "
Sep 15 09:41:37.646915 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.646605    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-model-cache\") pod \"b78f5411-3e51-4455-91cd-62fdc94add9a\" (UID: \"b78f5411-3e51-4455-91cd-62fdc94add9a\") "
Sep 15 09:41:37.646915 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.646663    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-home" (OuterVolumeSpecName: "home") pod "952ee430-3394-49f5-9764-a30c91dbb1fe" (UID: "952ee430-3394-49f5-9764-a30c91dbb1fe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:37.646915 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.646883    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-home" (OuterVolumeSpecName: "home") pod "b78f5411-3e51-4455-91cd-62fdc94add9a" (UID: "b78f5411-3e51-4455-91cd-62fdc94add9a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:37.647109 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.647028    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-home\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.647109 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.647045    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-home\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.647109 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.647058    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-tmp-dir\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.647109 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.647072    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-model-cache\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.647848 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.647824    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-model-cache" (OuterVolumeSpecName: "model-cache") pod "b78f5411-3e51-4455-91cd-62fdc94add9a" (UID: "b78f5411-3e51-4455-91cd-62fdc94add9a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:37.648341 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.648319    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "952ee430-3394-49f5-9764-a30c91dbb1fe" (UID: "952ee430-3394-49f5-9764-a30c91dbb1fe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:37.649668 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.649640    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b78f5411-3e51-4455-91cd-62fdc94add9a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b78f5411-3e51-4455-91cd-62fdc94add9a" (UID: "b78f5411-3e51-4455-91cd-62fdc94add9a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:41:37.649861 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.649696    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/952ee430-3394-49f5-9764-a30c91dbb1fe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "952ee430-3394-49f5-9764-a30c91dbb1fe" (UID: "952ee430-3394-49f5-9764-a30c91dbb1fe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:41:37.650132 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.650103    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/952ee430-3394-49f5-9764-a30c91dbb1fe-kube-api-access-v5t6q" (OuterVolumeSpecName: "kube-api-access-v5t6q") pod "952ee430-3394-49f5-9764-a30c91dbb1fe" (UID: "952ee430-3394-49f5-9764-a30c91dbb1fe"). InnerVolumeSpecName "kube-api-access-v5t6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:37.650229 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.650150    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-dshm" (OuterVolumeSpecName: "dshm") pod "b78f5411-3e51-4455-91cd-62fdc94add9a" (UID: "b78f5411-3e51-4455-91cd-62fdc94add9a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:37.651026 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.651008    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b78f5411-3e51-4455-91cd-62fdc94add9a-kube-api-access-7xr4h" (OuterVolumeSpecName: "kube-api-access-7xr4h") pod "b78f5411-3e51-4455-91cd-62fdc94add9a" (UID: "b78f5411-3e51-4455-91cd-62fdc94add9a"). InnerVolumeSpecName "kube-api-access-7xr4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:37.651825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.651804    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-dshm" (OuterVolumeSpecName: "dshm") pod "952ee430-3394-49f5-9764-a30c91dbb1fe" (UID: "952ee430-3394-49f5-9764-a30c91dbb1fe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:37.747970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.747896    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-dshm\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.747970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.747928    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xr4h\" (UniqueName: \"kubernetes.io/projected/b78f5411-3e51-4455-91cd-62fdc94add9a-kube-api-access-7xr4h\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.747970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.747940    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b78f5411-3e51-4455-91cd-62fdc94add9a-tls-certs\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.747970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.747949    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/952ee430-3394-49f5-9764-a30c91dbb1fe-tls-certs\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.747970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.747957    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/952ee430-3394-49f5-9764-a30c91dbb1fe-tmp-dir\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.747970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.747963    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-dshm\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.747970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.747971    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5t6q\" (UniqueName: \"kubernetes.io/projected/952ee430-3394-49f5-9764-a30c91dbb1fe-kube-api-access-v5t6q\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.748309 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.747979    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b78f5411-3e51-4455-91cd-62fdc94add9a-model-cache\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.876895 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.876861    2575 generic.go:356] "Generic (PLEG): container finished" podID="952ee430-3394-49f5-9764-a30c91dbb1fe" containerID="abcb91d219c51126ca5d568d466d6e400253096d43b9fb07bd9e6a6bc50090a2" exitCode=0
Sep 15 09:41:37.877076 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.876920    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"
Sep 15 09:41:37.877076 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.876953    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp" event={"ID":"952ee430-3394-49f5-9764-a30c91dbb1fe","Type":"ContainerDied","Data":"abcb91d219c51126ca5d568d466d6e400253096d43b9fb07bd9e6a6bc50090a2"}
Sep 15 09:41:37.877076 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.876992    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp" event={"ID":"952ee430-3394-49f5-9764-a30c91dbb1fe","Type":"ContainerDied","Data":"2c821690ca86c30b2e1a3417c2f8a69573cff9cf63810c33067c0f7a68b2e5c9"}
Sep 15 09:41:37.877076 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.877012    2575 scope.go:117] "RemoveContainer" containerID="abcb91d219c51126ca5d568d466d6e400253096d43b9fb07bd9e6a6bc50090a2"
Sep 15 09:41:37.878449 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.878415    2575 generic.go:356] "Generic (PLEG): container finished" podID="b78f5411-3e51-4455-91cd-62fdc94add9a" containerID="cf0eabb28d6bd49c23ff338338a79a37c49ab233f25f075088da744a560864d5" exitCode=0
Sep 15 09:41:37.878537 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.878465    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw" event={"ID":"b78f5411-3e51-4455-91cd-62fdc94add9a","Type":"ContainerDied","Data":"cf0eabb28d6bd49c23ff338338a79a37c49ab233f25f075088da744a560864d5"}
Sep 15 09:41:37.878537 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.878482    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"
Sep 15 09:41:37.878537 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.878500    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw" event={"ID":"b78f5411-3e51-4455-91cd-62fdc94add9a","Type":"ContainerDied","Data":"bb17ea361dfa0f684ee66919d511016ca3518faf904f509538c88989e9a74b15"}
Sep 15 09:41:37.888359 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.888332    2575 scope.go:117] "RemoveContainer" containerID="abcb91d219c51126ca5d568d466d6e400253096d43b9fb07bd9e6a6bc50090a2"
Sep 15 09:41:37.888711 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:41:37.888688    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abcb91d219c51126ca5d568d466d6e400253096d43b9fb07bd9e6a6bc50090a2\": container with ID starting with abcb91d219c51126ca5d568d466d6e400253096d43b9fb07bd9e6a6bc50090a2 not found: ID does not exist" containerID="abcb91d219c51126ca5d568d466d6e400253096d43b9fb07bd9e6a6bc50090a2"
Sep 15 09:41:37.888843 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.888719    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abcb91d219c51126ca5d568d466d6e400253096d43b9fb07bd9e6a6bc50090a2"} err="failed to get container status \"abcb91d219c51126ca5d568d466d6e400253096d43b9fb07bd9e6a6bc50090a2\": rpc error: code = NotFound desc = could not find container \"abcb91d219c51126ca5d568d466d6e400253096d43b9fb07bd9e6a6bc50090a2\": container with ID starting with abcb91d219c51126ca5d568d466d6e400253096d43b9fb07bd9e6a6bc50090a2 not found: ID does not exist"
Sep 15 09:41:37.888843 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.888738    2575 scope.go:117] "RemoveContainer" containerID="cf0eabb28d6bd49c23ff338338a79a37c49ab233f25f075088da744a560864d5"
Sep 15 09:41:37.897159 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.897139    2575 scope.go:117] "RemoveContainer" containerID="cf0eabb28d6bd49c23ff338338a79a37c49ab233f25f075088da744a560864d5"
Sep 15 09:41:37.897419 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:41:37.897402    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf0eabb28d6bd49c23ff338338a79a37c49ab233f25f075088da744a560864d5\": container with ID starting with cf0eabb28d6bd49c23ff338338a79a37c49ab233f25f075088da744a560864d5 not found: ID does not exist" containerID="cf0eabb28d6bd49c23ff338338a79a37c49ab233f25f075088da744a560864d5"
Sep 15 09:41:37.897487 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.897423    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf0eabb28d6bd49c23ff338338a79a37c49ab233f25f075088da744a560864d5"} err="failed to get container status \"cf0eabb28d6bd49c23ff338338a79a37c49ab233f25f075088da744a560864d5\": rpc error: code = NotFound desc = could not find container \"cf0eabb28d6bd49c23ff338338a79a37c49ab233f25f075088da744a560864d5\": container with ID starting with cf0eabb28d6bd49c23ff338338a79a37c49ab233f25f075088da744a560864d5 not found: ID does not exist"
Sep 15 09:41:37.898584 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.898562    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"]
Sep 15 09:41:37.901920 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.901884    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/distinct-2-w0-e76bac-kserve-78fdd9b59b-xpfjp"]
Sep 15 09:41:37.911076 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.911052    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"]
Sep 15 09:41:37.913008 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:37.912985    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/embedding-w0-e76bac-kserve-65558df7d4-gnbkw"]
Sep 15 09:41:38.860691 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:38.860661    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="952ee430-3394-49f5-9764-a30c91dbb1fe" path="/var/lib/kubelet/pods/952ee430-3394-49f5-9764-a30c91dbb1fe/volumes"
Sep 15 09:41:38.861079 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:38.861063    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b78f5411-3e51-4455-91cd-62fdc94add9a" path="/var/lib/kubelet/pods/b78f5411-3e51-4455-91cd-62fdc94add9a/volumes"
Sep 15 09:41:42.749838 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.749810    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:41:42.897622 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.897592    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-podinfo\") pod \"6afb041d-1884-4e0b-ac8c-8e14813068c2\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") "
Sep 15 09:41:42.897823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.897639    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-workload-socket\") pod \"6afb041d-1884-4e0b-ac8c-8e14813068c2\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") "
Sep 15 09:41:42.897823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.897674    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-workload-certs\") pod \"6afb041d-1884-4e0b-ac8c-8e14813068c2\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") "
Sep 15 09:41:42.897823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.897702    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwfj5\" (UniqueName: \"kubernetes.io/projected/6afb041d-1884-4e0b-ac8c-8e14813068c2-kube-api-access-qwfj5\") pod \"6afb041d-1884-4e0b-ac8c-8e14813068c2\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") "
Sep 15 09:41:42.897823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.897734    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-envoy\") pod \"6afb041d-1884-4e0b-ac8c-8e14813068c2\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") "
Sep 15 09:41:42.898064 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.897866    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-token\") pod \"6afb041d-1884-4e0b-ac8c-8e14813068c2\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") "
Sep 15 09:41:42.898064 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.897944    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6afb041d-1884-4e0b-ac8c-8e14813068c2-istiod-ca-cert\") pod \"6afb041d-1884-4e0b-ac8c-8e14813068c2\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") "
Sep 15 09:41:42.898064 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.897976    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-data\") pod \"6afb041d-1884-4e0b-ac8c-8e14813068c2\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") "
Sep 15 09:41:42.898064 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.898002    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-credential-socket\") pod \"6afb041d-1884-4e0b-ac8c-8e14813068c2\" (UID: \"6afb041d-1884-4e0b-ac8c-8e14813068c2\") "
Sep 15 09:41:42.898064 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.898030    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6afb041d-1884-4e0b-ac8c-8e14813068c2" (UID: "6afb041d-1884-4e0b-ac8c-8e14813068c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:42.898064 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.898048    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6afb041d-1884-4e0b-ac8c-8e14813068c2" (UID: "6afb041d-1884-4e0b-ac8c-8e14813068c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:42.898348 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.898275    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-workload-socket\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:42.898348 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.898274    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-data" (OuterVolumeSpecName: "istio-data") pod "6afb041d-1884-4e0b-ac8c-8e14813068c2" (UID: "6afb041d-1884-4e0b-ac8c-8e14813068c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:42.898348 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.898291    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-workload-certs\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:42.898504 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.898357    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6afb041d-1884-4e0b-ac8c-8e14813068c2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6afb041d-1884-4e0b-ac8c-8e14813068c2" (UID: "6afb041d-1884-4e0b-ac8c-8e14813068c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:41:42.898566 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.898523    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6afb041d-1884-4e0b-ac8c-8e14813068c2" (UID: "6afb041d-1884-4e0b-ac8c-8e14813068c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:42.900022 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.899995    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6afb041d-1884-4e0b-ac8c-8e14813068c2" (UID: "6afb041d-1884-4e0b-ac8c-8e14813068c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:42.900124 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.900038    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6afb041d-1884-4e0b-ac8c-8e14813068c2-kube-api-access-qwfj5" (OuterVolumeSpecName: "kube-api-access-qwfj5") pod "6afb041d-1884-4e0b-ac8c-8e14813068c2" (UID: "6afb041d-1884-4e0b-ac8c-8e14813068c2"). InnerVolumeSpecName "kube-api-access-qwfj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:42.900588 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.900566    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-token" (OuterVolumeSpecName: "istio-token") pod "6afb041d-1884-4e0b-ac8c-8e14813068c2" (UID: "6afb041d-1884-4e0b-ac8c-8e14813068c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:42.900588 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.900569    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6afb041d-1884-4e0b-ac8c-8e14813068c2" (UID: "6afb041d-1884-4e0b-ac8c-8e14813068c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:41:42.914257 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.914233    2575 generic.go:356] "Generic (PLEG): container finished" podID="6afb041d-1884-4e0b-ac8c-8e14813068c2" containerID="782a9b77ca7e62a1bc095c9990aad652b335d4cff708f451905f36d8dcb36767" exitCode=0
Sep 15 09:41:42.914372 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.914294    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"
Sep 15 09:41:42.914372 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.914313    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh" event={"ID":"6afb041d-1884-4e0b-ac8c-8e14813068c2","Type":"ContainerDied","Data":"782a9b77ca7e62a1bc095c9990aad652b335d4cff708f451905f36d8dcb36767"}
Sep 15 09:41:42.914500 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.914377    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh" event={"ID":"6afb041d-1884-4e0b-ac8c-8e14813068c2","Type":"ContainerDied","Data":"12e0099069534a874113f45e174ee23d2e7d70ceadeb874c7a416576932a3cee"}
Sep 15 09:41:42.914500 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.914408    2575 scope.go:117] "RemoveContainer" containerID="782a9b77ca7e62a1bc095c9990aad652b335d4cff708f451905f36d8dcb36767"
Sep 15 09:41:42.924435 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.924411    2575 scope.go:117] "RemoveContainer" containerID="0245bec65e56b0d31e0dced87398f5ecd5b8ebad5454b71bc81bfb4e37a5fe05"
Sep 15 09:41:42.933271 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.933257    2575 scope.go:117] "RemoveContainer" containerID="782a9b77ca7e62a1bc095c9990aad652b335d4cff708f451905f36d8dcb36767"
Sep 15 09:41:42.933535 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:41:42.933517    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"782a9b77ca7e62a1bc095c9990aad652b335d4cff708f451905f36d8dcb36767\": container with ID starting with 782a9b77ca7e62a1bc095c9990aad652b335d4cff708f451905f36d8dcb36767 not found: ID does not exist" containerID="782a9b77ca7e62a1bc095c9990aad652b335d4cff708f451905f36d8dcb36767"
Sep 15 09:41:42.933583 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.933542    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"782a9b77ca7e62a1bc095c9990aad652b335d4cff708f451905f36d8dcb36767"} err="failed to get container status \"782a9b77ca7e62a1bc095c9990aad652b335d4cff708f451905f36d8dcb36767\": rpc error: code = NotFound desc = could not find container \"782a9b77ca7e62a1bc095c9990aad652b335d4cff708f451905f36d8dcb36767\": container with ID starting with 782a9b77ca7e62a1bc095c9990aad652b335d4cff708f451905f36d8dcb36767 not found: ID does not exist"
Sep 15 09:41:42.933583 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.933557    2575 scope.go:117] "RemoveContainer" containerID="0245bec65e56b0d31e0dced87398f5ecd5b8ebad5454b71bc81bfb4e37a5fe05"
Sep 15 09:41:42.933821 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:41:42.933802    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0245bec65e56b0d31e0dced87398f5ecd5b8ebad5454b71bc81bfb4e37a5fe05\": container with ID starting with 0245bec65e56b0d31e0dced87398f5ecd5b8ebad5454b71bc81bfb4e37a5fe05 not found: ID does not exist" containerID="0245bec65e56b0d31e0dced87398f5ecd5b8ebad5454b71bc81bfb4e37a5fe05"
Sep 15 09:41:42.933869 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.933827    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0245bec65e56b0d31e0dced87398f5ecd5b8ebad5454b71bc81bfb4e37a5fe05"} err="failed to get container status \"0245bec65e56b0d31e0dced87398f5ecd5b8ebad5454b71bc81bfb4e37a5fe05\": rpc error: code = NotFound desc = could not find container \"0245bec65e56b0d31e0dced87398f5ecd5b8ebad5454b71bc81bfb4e37a5fe05\": container with ID starting with 0245bec65e56b0d31e0dced87398f5ecd5b8ebad5454b71bc81bfb4e37a5fe05 not found: ID does not exist"
Sep 15 09:41:42.939309 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.939288    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"]
Sep 15 09:41:42.942924 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.942900    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-e76bac-openshift-default-9fdd4bcd4-sfdnh"]
Sep 15 09:41:42.998803 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.998781    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwfj5\" (UniqueName: \"kubernetes.io/projected/6afb041d-1884-4e0b-ac8c-8e14813068c2-kube-api-access-qwfj5\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:42.998928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.998807    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-envoy\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:42.998928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.998822    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-token\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:42.998928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.998831    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6afb041d-1884-4e0b-ac8c-8e14813068c2-istiod-ca-cert\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:42.998928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.998838    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-data\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:42.998928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.998846    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6afb041d-1884-4e0b-ac8c-8e14813068c2-credential-socket\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:42.998928 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:42.998853    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6afb041d-1884-4e0b-ac8c-8e14813068c2-istio-podinfo\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:41:44.859380 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:44.859346    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6afb041d-1884-4e0b-ac8c-8e14813068c2" path="/var/lib/kubelet/pods/6afb041d-1884-4e0b-ac8c-8e14813068c2/volumes"
Sep 15 09:41:57.068397 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:57.068362    2575 scope.go:117] "RemoveContainer" containerID="ad6fd1757636651d917904298e7e152d151c676f82de5daa19dba3444b21b897"
Sep 15 09:41:58.736161 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:58.736122    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:58.836616 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:58.836584    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:41:59.966330 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:41:59.966300    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:14.244313 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:14.244274    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:17.935951 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:17.935871    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:18.048438 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048405    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224"]
Sep 15 09:42:18.048857 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048843    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb3ffae6-5cd7-4649-89e0-5f673dc96366" containerName="payload-pre-processing"
Sep 15 09:42:18.048920 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048859    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb3ffae6-5cd7-4649-89e0-5f673dc96366" containerName="payload-pre-processing"
Sep 15 09:42:18.048920 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048869    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b78f5411-3e51-4455-91cd-62fdc94add9a" containerName="main"
Sep 15 09:42:18.048920 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048875    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b78f5411-3e51-4455-91cd-62fdc94add9a" containerName="main"
Sep 15 09:42:18.048920 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048880    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d7604e5-435f-4fe2-8c07-5584bc629786" containerName="revoke-keys"
Sep 15 09:42:18.048920 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048885    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d7604e5-435f-4fe2-8c07-5584bc629786" containerName="revoke-keys"
Sep 15 09:42:18.048920 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048894    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6afb041d-1884-4e0b-ac8c-8e14813068c2" containerName="istio-proxy"
Sep 15 09:42:18.048920 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048899    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6afb041d-1884-4e0b-ac8c-8e14813068c2" containerName="istio-proxy"
Sep 15 09:42:18.048920 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048906    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="952ee430-3394-49f5-9764-a30c91dbb1fe" containerName="main"
Sep 15 09:42:18.048920 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048911    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="952ee430-3394-49f5-9764-a30c91dbb1fe" containerName="main"
Sep 15 09:42:18.048920 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048922    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01c903f2-8a23-400f-936d-e50f0e4e9dc1" containerName="istio-proxy"
Sep 15 09:42:18.049254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048927    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="01c903f2-8a23-400f-936d-e50f0e4e9dc1" containerName="istio-proxy"
Sep 15 09:42:18.049254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048933    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6afb041d-1884-4e0b-ac8c-8e14813068c2" containerName="istio-proxy"
Sep 15 09:42:18.049254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048939    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6afb041d-1884-4e0b-ac8c-8e14813068c2" containerName="istio-proxy"
Sep 15 09:42:18.049254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048955    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01c903f2-8a23-400f-936d-e50f0e4e9dc1" containerName="istio-proxy"
Sep 15 09:42:18.049254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048960    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="01c903f2-8a23-400f-936d-e50f0e4e9dc1" containerName="istio-proxy"
Sep 15 09:42:18.049254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048966    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24d4fdc1-5c00-4e07-88be-d2ca578321f1" containerName="payload-processing"
Sep 15 09:42:18.049254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.048971    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="24d4fdc1-5c00-4e07-88be-d2ca578321f1" containerName="payload-processing"
Sep 15 09:42:18.049254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.049030    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6afb041d-1884-4e0b-ac8c-8e14813068c2" containerName="istio-proxy"
Sep 15 09:42:18.049254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.049036    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="952ee430-3394-49f5-9764-a30c91dbb1fe" containerName="main"
Sep 15 09:42:18.049254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.049043    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="24d4fdc1-5c00-4e07-88be-d2ca578321f1" containerName="payload-processing"
Sep 15 09:42:18.049254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.049049    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb3ffae6-5cd7-4649-89e0-5f673dc96366" containerName="payload-pre-processing"
Sep 15 09:42:18.049254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.049055    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d7604e5-435f-4fe2-8c07-5584bc629786" containerName="revoke-keys"
Sep 15 09:42:18.049254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.049061    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6afb041d-1884-4e0b-ac8c-8e14813068c2" containerName="istio-proxy"
Sep 15 09:42:18.049254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.049068    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="01c903f2-8a23-400f-936d-e50f0e4e9dc1" containerName="istio-proxy"
Sep 15 09:42:18.049254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.049073    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="01c903f2-8a23-400f-936d-e50f0e4e9dc1" containerName="istio-proxy"
Sep 15 09:42:18.049254 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.049078    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b78f5411-3e51-4455-91cd-62fdc94add9a" containerName="main"
Sep 15 09:42:18.052190 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.052173    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224"
Sep 15 09:42:18.054319 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.054300    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:42:18.059648 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.059622    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224"]
Sep 15 09:42:18.113607 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.113572    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/971a6bb7-f13b-4f77-b030-e3e73347a2ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224\" (UID: \"971a6bb7-f13b-4f77-b030-e3e73347a2ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224"
Sep 15 09:42:18.215146 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.215068    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/971a6bb7-f13b-4f77-b030-e3e73347a2ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224\" (UID: \"971a6bb7-f13b-4f77-b030-e3e73347a2ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224"
Sep 15 09:42:18.215678 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.215658    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/971a6bb7-f13b-4f77-b030-e3e73347a2ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224\" (UID: \"971a6bb7-f13b-4f77-b030-e3e73347a2ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224"
Sep 15 09:42:18.344886 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.344850    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:18.365857 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.365829    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224"
Sep 15 09:42:18.635648 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:18.635620    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224"]
Sep 15 09:42:18.638096 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:42:18.638067    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971a6bb7_f13b_4f77_b030_e3e73347a2ae.slice/crio-bb567e7b21bf0d4c6918564df8b491302307087708b0e8ae83a6825fb0d84371 WatchSource:0}: Error finding container bb567e7b21bf0d4c6918564df8b491302307087708b0e8ae83a6825fb0d84371: Status 404 returned error can't find the container with id bb567e7b21bf0d4c6918564df8b491302307087708b0e8ae83a6825fb0d84371
Sep 15 09:42:19.022216 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:19.022187    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:19.116976 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:19.116934    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224" event={"ID":"971a6bb7-f13b-4f77-b030-e3e73347a2ae","Type":"ContainerStarted","Data":"080a8a907d4f40c901f5f4b6060a89204805380391e2070c6f27bfc32f9fc8f3"}
Sep 15 09:42:19.117137 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:19.116999    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224" event={"ID":"971a6bb7-f13b-4f77-b030-e3e73347a2ae","Type":"ContainerStarted","Data":"bb567e7b21bf0d4c6918564df8b491302307087708b0e8ae83a6825fb0d84371"}
Sep 15 09:42:19.131836 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:19.131795    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224" podStartSLOduration=1.13178011 podStartE2EDuration="1.13178011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:42:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:42:19.129993781 +0000 UTC m=+1702.779409874" watchObservedRunningTime="2026-09-15 09:42:19.13178011 +0000 UTC m=+1702.781196194"
Sep 15 09:42:19.738437 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:19.738401    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:20.124627 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:20.124536    2575 generic.go:356] "Generic (PLEG): container finished" podID="971a6bb7-f13b-4f77-b030-e3e73347a2ae" containerID="080a8a907d4f40c901f5f4b6060a89204805380391e2070c6f27bfc32f9fc8f3" exitCode=0
Sep 15 09:42:20.124627 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:20.124588    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224" event={"ID":"971a6bb7-f13b-4f77-b030-e3e73347a2ae","Type":"ContainerDied","Data":"080a8a907d4f40c901f5f4b6060a89204805380391e2070c6f27bfc32f9fc8f3"}
Sep 15 09:42:20.421399 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:20.421365    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:21.198033 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:21.198002    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:21.276058 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:21.276032    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224"
Sep 15 09:42:21.346103 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:21.346077    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/971a6bb7-f13b-4f77-b030-e3e73347a2ae-maas-api-service-ca\") pod \"971a6bb7-f13b-4f77-b030-e3e73347a2ae\" (UID: \"971a6bb7-f13b-4f77-b030-e3e73347a2ae\") "
Sep 15 09:42:21.346456 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:21.346431    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/971a6bb7-f13b-4f77-b030-e3e73347a2ae-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "971a6bb7-f13b-4f77-b030-e3e73347a2ae" (UID: "971a6bb7-f13b-4f77-b030-e3e73347a2ae"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:42:21.447213 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:21.447178    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/971a6bb7-f13b-4f77-b030-e3e73347a2ae-maas-api-service-ca\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:42:22.137780 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:22.137747    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224"
Sep 15 09:42:22.138016 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:22.137789    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224" event={"ID":"971a6bb7-f13b-4f77-b030-e3e73347a2ae","Type":"ContainerDied","Data":"bb567e7b21bf0d4c6918564df8b491302307087708b0e8ae83a6825fb0d84371"}
Sep 15 09:42:22.138016 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:22.137836    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb567e7b21bf0d4c6918564df8b491302307087708b0e8ae83a6825fb0d84371"
Sep 15 09:42:22.997914 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:22.997869    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:23.583052 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:23.583016    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:33.592174 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:33.592141    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c183a5-29824410-gzzcg"]
Sep 15 09:42:33.594144 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:33.594123    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c183a5-29824410-gzzcg"]
Sep 15 09:42:33.615039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:33.615009    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"]
Sep 15 09:42:33.615723 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:33.615670    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj" podUID="d80c6f54-686c-4380-94f9-bf97e0ee532d" containerName="payload-processing" containerID="cri-o://acd17b51be71dc59bf43720b5b57fe18cb0be135de00877cfe69e1ee7421263a" gracePeriod=30
Sep 15 09:42:33.624780 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:33.624744    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"]
Sep 15 09:42:33.625019 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:33.624996    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc" podUID="e2863c68-b405-45b7-b60b-932b60f6ff2d" containerName="payload-pre-processing" containerID="cri-o://9ead022723d49ff87a16884d9dec85b092fd88877abf82bbcd1591f3bf0c0c8d" gracePeriod=30
Sep 15 09:42:33.757172 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:33.757129    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:33.774039 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:33.773979    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224"]
Sep 15 09:42:33.776613 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:33.776520    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c183a5-mr224"]
Sep 15 09:42:33.857279 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:33.857209    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:33.896478 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:33.896164    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"
Sep 15 09:42:33.947362 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:33.947334    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"
Sep 15 09:42:34.063666 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.063632    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7mlk\" (UniqueName: \"kubernetes.io/projected/e2863c68-b405-45b7-b60b-932b60f6ff2d-kube-api-access-f7mlk\") pod \"e2863c68-b405-45b7-b60b-932b60f6ff2d\" (UID: \"e2863c68-b405-45b7-b60b-932b60f6ff2d\") "
Sep 15 09:42:34.063877 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.063685    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9wjt\" (UniqueName: \"kubernetes.io/projected/d80c6f54-686c-4380-94f9-bf97e0ee532d-kube-api-access-d9wjt\") pod \"d80c6f54-686c-4380-94f9-bf97e0ee532d\" (UID: \"d80c6f54-686c-4380-94f9-bf97e0ee532d\") "
Sep 15 09:42:34.063877 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.063720    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2863c68-b405-45b7-b60b-932b60f6ff2d-plugins-config-volume\") pod \"e2863c68-b405-45b7-b60b-932b60f6ff2d\" (UID: \"e2863c68-b405-45b7-b60b-932b60f6ff2d\") "
Sep 15 09:42:34.063877 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.063798    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d80c6f54-686c-4380-94f9-bf97e0ee532d-plugins-config-volume\") pod \"d80c6f54-686c-4380-94f9-bf97e0ee532d\" (UID: \"d80c6f54-686c-4380-94f9-bf97e0ee532d\") "
Sep 15 09:42:34.064195 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.064164    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2863c68-b405-45b7-b60b-932b60f6ff2d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e2863c68-b405-45b7-b60b-932b60f6ff2d" (UID: "e2863c68-b405-45b7-b60b-932b60f6ff2d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:42:34.064312 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.064207    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d80c6f54-686c-4380-94f9-bf97e0ee532d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d80c6f54-686c-4380-94f9-bf97e0ee532d" (UID: "d80c6f54-686c-4380-94f9-bf97e0ee532d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:42:34.065912 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.065881    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2863c68-b405-45b7-b60b-932b60f6ff2d-kube-api-access-f7mlk" (OuterVolumeSpecName: "kube-api-access-f7mlk") pod "e2863c68-b405-45b7-b60b-932b60f6ff2d" (UID: "e2863c68-b405-45b7-b60b-932b60f6ff2d"). InnerVolumeSpecName "kube-api-access-f7mlk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:42:34.066391 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.066368    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d80c6f54-686c-4380-94f9-bf97e0ee532d-kube-api-access-d9wjt" (OuterVolumeSpecName: "kube-api-access-d9wjt") pod "d80c6f54-686c-4380-94f9-bf97e0ee532d" (UID: "d80c6f54-686c-4380-94f9-bf97e0ee532d"). InnerVolumeSpecName "kube-api-access-d9wjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:42:34.123451 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.123358    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:34.164833 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.164796    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7mlk\" (UniqueName: \"kubernetes.io/projected/e2863c68-b405-45b7-b60b-932b60f6ff2d-kube-api-access-f7mlk\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:42:34.164833 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.164828    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9wjt\" (UniqueName: \"kubernetes.io/projected/d80c6f54-686c-4380-94f9-bf97e0ee532d-kube-api-access-d9wjt\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:42:34.165025 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.164840    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2863c68-b405-45b7-b60b-932b60f6ff2d-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:42:34.165025 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.164852    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d80c6f54-686c-4380-94f9-bf97e0ee532d-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:42:34.208303 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.208269    2575 generic.go:356] "Generic (PLEG): container finished" podID="e2863c68-b405-45b7-b60b-932b60f6ff2d" containerID="9ead022723d49ff87a16884d9dec85b092fd88877abf82bbcd1591f3bf0c0c8d" exitCode=0
Sep 15 09:42:34.208473 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.208317    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"
Sep 15 09:42:34.208473 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.208353    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc" event={"ID":"e2863c68-b405-45b7-b60b-932b60f6ff2d","Type":"ContainerDied","Data":"9ead022723d49ff87a16884d9dec85b092fd88877abf82bbcd1591f3bf0c0c8d"}
Sep 15 09:42:34.208473 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.208403    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc" event={"ID":"e2863c68-b405-45b7-b60b-932b60f6ff2d","Type":"ContainerDied","Data":"a290134f37930279308b17f1a7770db171dbd482132f52a838e3f4b8f52d7456"}
Sep 15 09:42:34.208473 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.208424    2575 scope.go:117] "RemoveContainer" containerID="9ead022723d49ff87a16884d9dec85b092fd88877abf82bbcd1591f3bf0c0c8d"
Sep 15 09:42:34.209811 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.209791    2575 generic.go:356] "Generic (PLEG): container finished" podID="d80c6f54-686c-4380-94f9-bf97e0ee532d" containerID="acd17b51be71dc59bf43720b5b57fe18cb0be135de00877cfe69e1ee7421263a" exitCode=0
Sep 15 09:42:34.209934 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.209828    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"
Sep 15 09:42:34.209934 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.209854    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj" event={"ID":"d80c6f54-686c-4380-94f9-bf97e0ee532d","Type":"ContainerDied","Data":"acd17b51be71dc59bf43720b5b57fe18cb0be135de00877cfe69e1ee7421263a"}
Sep 15 09:42:34.209934 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.209884    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj" event={"ID":"d80c6f54-686c-4380-94f9-bf97e0ee532d","Type":"ContainerDied","Data":"a9d38a9a46b0b11fb9b79594bc87a627aa998b3e35ee576fec853d5598ab2ff2"}
Sep 15 09:42:34.218953 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.218937    2575 scope.go:117] "RemoveContainer" containerID="9ead022723d49ff87a16884d9dec85b092fd88877abf82bbcd1591f3bf0c0c8d"
Sep 15 09:42:34.219347 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:42:34.219327    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ead022723d49ff87a16884d9dec85b092fd88877abf82bbcd1591f3bf0c0c8d\": container with ID starting with 9ead022723d49ff87a16884d9dec85b092fd88877abf82bbcd1591f3bf0c0c8d not found: ID does not exist" containerID="9ead022723d49ff87a16884d9dec85b092fd88877abf82bbcd1591f3bf0c0c8d"
Sep 15 09:42:34.219459 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.219358    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ead022723d49ff87a16884d9dec85b092fd88877abf82bbcd1591f3bf0c0c8d"} err="failed to get container status \"9ead022723d49ff87a16884d9dec85b092fd88877abf82bbcd1591f3bf0c0c8d\": rpc error: code = NotFound desc = could not find container \"9ead022723d49ff87a16884d9dec85b092fd88877abf82bbcd1591f3bf0c0c8d\": container with ID starting with 9ead022723d49ff87a16884d9dec85b092fd88877abf82bbcd1591f3bf0c0c8d not found: ID does not exist"
Sep 15 09:42:34.219459 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.219380    2575 scope.go:117] "RemoveContainer" containerID="acd17b51be71dc59bf43720b5b57fe18cb0be135de00877cfe69e1ee7421263a"
Sep 15 09:42:34.227952 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.227936    2575 scope.go:117] "RemoveContainer" containerID="acd17b51be71dc59bf43720b5b57fe18cb0be135de00877cfe69e1ee7421263a"
Sep 15 09:42:34.228187 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:42:34.228171    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acd17b51be71dc59bf43720b5b57fe18cb0be135de00877cfe69e1ee7421263a\": container with ID starting with acd17b51be71dc59bf43720b5b57fe18cb0be135de00877cfe69e1ee7421263a not found: ID does not exist" containerID="acd17b51be71dc59bf43720b5b57fe18cb0be135de00877cfe69e1ee7421263a"
Sep 15 09:42:34.228228 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.228195    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd17b51be71dc59bf43720b5b57fe18cb0be135de00877cfe69e1ee7421263a"} err="failed to get container status \"acd17b51be71dc59bf43720b5b57fe18cb0be135de00877cfe69e1ee7421263a\": rpc error: code = NotFound desc = could not find container \"acd17b51be71dc59bf43720b5b57fe18cb0be135de00877cfe69e1ee7421263a\": container with ID starting with acd17b51be71dc59bf43720b5b57fe18cb0be135de00877cfe69e1ee7421263a not found: ID does not exist"
Sep 15 09:42:34.233367 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.233318    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"]
Sep 15 09:42:34.237104 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.237076    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:34.237389 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.237371    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c183a5-8c7c56854-wjpjc"]
Sep 15 09:42:34.248385 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.248361    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"]
Sep 15 09:42:34.250934 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.250914    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-c183a5-6d5867f857-c7zxj"]
Sep 15 09:42:34.861310 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.861272    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="971a6bb7-f13b-4f77-b030-e3e73347a2ae" path="/var/lib/kubelet/pods/971a6bb7-f13b-4f77-b030-e3e73347a2ae/volumes"
Sep 15 09:42:34.861850 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.861830    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d80c6f54-686c-4380-94f9-bf97e0ee532d" path="/var/lib/kubelet/pods/d80c6f54-686c-4380-94f9-bf97e0ee532d/volumes"
Sep 15 09:42:34.862343 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.862322    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2863c68-b405-45b7-b60b-932b60f6ff2d" path="/var/lib/kubelet/pods/e2863c68-b405-45b7-b60b-932b60f6ff2d/volumes"
Sep 15 09:42:34.862631 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:34.862614    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec6627e3-3844-44a0-bbf5-135d7173512b" path="/var/lib/kubelet/pods/ec6627e3-3844-44a0-bbf5-135d7173512b/volumes"
Sep 15 09:42:35.001575 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:35.001506    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:35.759369 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:35.759314    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:39.757483 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:39.757450    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:39.857123 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:39.857087    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:40.009541 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:40.009451    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:57.119478 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:57.119450    2575 scope.go:117] "RemoveContainer" containerID="3ff76cd1bb8023204eb3adb7ce02f5cd0d66da13ea304147552c5e47af5f8250"
Sep 15 09:42:59.566381 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:59.566333    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:42:59.615941 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:42:59.615903    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:43:00.478749 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:00.478718    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:43:01.003003 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:01.002931    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:43:03.034465 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:03.034427    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"]
Sep 15 09:43:03.260623 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:03.260577    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:43:06.000517 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:06.000485    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:43:10.721044 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:10.721003    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:43:18.055727 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.055686    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p" podUID="7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0" containerName="main" containerID="cri-o://fba4849cd022aa79f4f89c75232d7bd2718e3447677cc417a8423a69360336e0" gracePeriod=45
Sep 15 09:43:18.300958 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.300936    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:43:18.457879 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.457836    2575 generic.go:356] "Generic (PLEG): container finished" podID="7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0" containerID="fba4849cd022aa79f4f89c75232d7bd2718e3447677cc417a8423a69360336e0" exitCode=0
Sep 15 09:43:18.458057 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.457891    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"
Sep 15 09:43:18.458057 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.457930    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p" event={"ID":"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0","Type":"ContainerDied","Data":"fba4849cd022aa79f4f89c75232d7bd2718e3447677cc417a8423a69360336e0"}
Sep 15 09:43:18.458057 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.457984    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p" event={"ID":"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0","Type":"ContainerDied","Data":"e1a08b47eee4ff224f14ed080f648a12b56e029cb915e9e8be3fe2f3f3428341"}
Sep 15 09:43:18.458057 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.458006    2575 scope.go:117] "RemoveContainer" containerID="fba4849cd022aa79f4f89c75232d7bd2718e3447677cc417a8423a69360336e0"
Sep 15 09:43:18.465466 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.465445    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-model-cache\") pod \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") "
Sep 15 09:43:18.465634 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.465485    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-home\") pod \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") "
Sep 15 09:43:18.465634 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.465532    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-tls-certs\") pod \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") "
Sep 15 09:43:18.465634 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.465553    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-dshm\") pod \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") "
Sep 15 09:43:18.465634 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.465584    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g579n\" (UniqueName: \"kubernetes.io/projected/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-kube-api-access-g579n\") pod \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") "
Sep 15 09:43:18.465634 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.465602    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-tmp-dir\") pod \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\" (UID: \"7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0\") "
Sep 15 09:43:18.465937 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.465740    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-model-cache" (OuterVolumeSpecName: "model-cache") pod "7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0" (UID: "7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:43:18.465937 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.465832    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-home" (OuterVolumeSpecName: "home") pod "7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0" (UID: "7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:43:18.466082 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.466053    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0" (UID: "7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:43:18.466141 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.466065    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-model-cache\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:43:18.466141 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.466118    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-home\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:43:18.467074 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.467056    2575 scope.go:117] "RemoveContainer" containerID="fba4849cd022aa79f4f89c75232d7bd2718e3447677cc417a8423a69360336e0"
Sep 15 09:43:18.467380 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:43:18.467360    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fba4849cd022aa79f4f89c75232d7bd2718e3447677cc417a8423a69360336e0\": container with ID starting with fba4849cd022aa79f4f89c75232d7bd2718e3447677cc417a8423a69360336e0 not found: ID does not exist" containerID="fba4849cd022aa79f4f89c75232d7bd2718e3447677cc417a8423a69360336e0"
Sep 15 09:43:18.467453 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.467388    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fba4849cd022aa79f4f89c75232d7bd2718e3447677cc417a8423a69360336e0"} err="failed to get container status \"fba4849cd022aa79f4f89c75232d7bd2718e3447677cc417a8423a69360336e0\": rpc error: code = NotFound desc = could not find container \"fba4849cd022aa79f4f89c75232d7bd2718e3447677cc417a8423a69360336e0\": container with ID starting with fba4849cd022aa79f4f89c75232d7bd2718e3447677cc417a8423a69360336e0 not found: ID does not exist"
Sep 15 09:43:18.468094 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.468065    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-kube-api-access-g579n" (OuterVolumeSpecName: "kube-api-access-g579n") pod "7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0" (UID: "7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0"). InnerVolumeSpecName "kube-api-access-g579n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:43:18.468335 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.468315    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-dshm" (OuterVolumeSpecName: "dshm") pod "7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0" (UID: "7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:43:18.468335 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.468319    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0" (UID: "7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:43:18.566566 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.566537    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-tls-certs\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:43:18.566566 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.566563    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-dshm\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:43:18.566720 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.566572    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g579n\" (UniqueName: \"kubernetes.io/projected/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-kube-api-access-g579n\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:43:18.566720 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.566582    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0-tmp-dir\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:43:18.782550 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.782524    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"]
Sep 15 09:43:18.785810 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.785785    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b283ee/auth-test-model-b283ee-kserve-5496577599-k9h7p"]
Sep 15 09:43:18.859788 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:18.859726    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0" path="/var/lib/kubelet/pods/7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0/volumes"
Sep 15 09:43:37.521092 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:37.521053    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:43:56.965596 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:56.965571    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:43:56.966391 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:56.966371    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:43:56.972136 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:56.972115    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:43:56.973114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:56.973092    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:43:58.608661 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:58.608624    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:43:58.660238 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:43:58.660211    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:44:12.302594 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:44:12.302560    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:44:13.306730 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:44:13.306694    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:44:21.517564 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:44:21.517531    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:44:49.134876 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:44:49.134847    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:00.137783 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.137736    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-864b9a-29824425-5xg28"]
Sep 15 09:45:00.138196 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.138180    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d80c6f54-686c-4380-94f9-bf97e0ee532d" containerName="payload-processing"
Sep 15 09:45:00.138241 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.138200    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d80c6f54-686c-4380-94f9-bf97e0ee532d" containerName="payload-processing"
Sep 15 09:45:00.138241 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.138227    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0" containerName="main"
Sep 15 09:45:00.138241 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.138232    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0" containerName="main"
Sep 15 09:45:00.138241 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.138241    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2863c68-b405-45b7-b60b-932b60f6ff2d" containerName="payload-pre-processing"
Sep 15 09:45:00.138370 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.138247    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2863c68-b405-45b7-b60b-932b60f6ff2d" containerName="payload-pre-processing"
Sep 15 09:45:00.138370 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.138257    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971a6bb7-f13b-4f77-b030-e3e73347a2ae" containerName="revoke-keys"
Sep 15 09:45:00.138370 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.138261    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="971a6bb7-f13b-4f77-b030-e3e73347a2ae" containerName="revoke-keys"
Sep 15 09:45:00.138370 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.138333    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ab4e4d7-9c95-4658-9994-b5c2a9ad84a0" containerName="main"
Sep 15 09:45:00.138370 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.138341    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="971a6bb7-f13b-4f77-b030-e3e73347a2ae" containerName="revoke-keys"
Sep 15 09:45:00.138370 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.138348    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2863c68-b405-45b7-b60b-932b60f6ff2d" containerName="payload-pre-processing"
Sep 15 09:45:00.138370 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.138355    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d80c6f54-686c-4380-94f9-bf97e0ee532d" containerName="payload-processing"
Sep 15 09:45:00.141315 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.141292    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b283ee-29824425-fpkfm"]
Sep 15 09:45:00.141436 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.141419    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-864b9a-29824425-5xg28"
Sep 15 09:45:00.143716 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.143693    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:45:00.145092 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.145031    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b283ee-29824425-fpkfm"
Sep 15 09:45:00.149970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.149951    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-864b9a-29824425-5xg28"]
Sep 15 09:45:00.151816 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.151792    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b283ee-29824425-fpkfm"]
Sep 15 09:45:00.158835 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.158816    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-864b9a-29824425-5xg28"
Sep 15 09:45:00.169178 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.169157    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b283ee-29824425-fpkfm"
Sep 15 09:45:00.440274 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.440163    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-864b9a-29824425-5xg28"]
Sep 15 09:45:00.441829 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:45:00.441791    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e1f29ca_f139_4df4_b93a_e567b0d26977.slice/crio-0df4382c10b5e42c97a110ceeb18afe628be51de341f25a4e8f7d93b1fa81f7f WatchSource:0}: Error finding container 0df4382c10b5e42c97a110ceeb18afe628be51de341f25a4e8f7d93b1fa81f7f: Status 404 returned error can't find the container with id 0df4382c10b5e42c97a110ceeb18afe628be51de341f25a4e8f7d93b1fa81f7f
Sep 15 09:45:00.442986 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:00.442957    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b283ee-29824425-fpkfm"]
Sep 15 09:45:00.444490 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:45:00.444459    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb452d3b_4345_49f0_ab42_e436f1ea987c.slice/crio-12433a8f254b969d087916566c5ff46ae753ed6176862f5148fa42961b76882a WatchSource:0}: Error finding container 12433a8f254b969d087916566c5ff46ae753ed6176862f5148fa42961b76882a: Status 404 returned error can't find the container with id 12433a8f254b969d087916566c5ff46ae753ed6176862f5148fa42961b76882a
Sep 15 09:45:01.010035 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:01.009944    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b283ee-29824425-fpkfm" event={"ID":"db452d3b-4345-49f0-ab42-e436f1ea987c","Type":"ContainerStarted","Data":"024d0c4e825cf7c735119e6c665db16f3c7b73feb6c0864c597fc4ab953079c5"}
Sep 15 09:45:01.010035 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:01.010003    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b283ee-29824425-fpkfm" event={"ID":"db452d3b-4345-49f0-ab42-e436f1ea987c","Type":"ContainerStarted","Data":"12433a8f254b969d087916566c5ff46ae753ed6176862f5148fa42961b76882a"}
Sep 15 09:45:01.011439 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:01.011414    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-864b9a-29824425-5xg28" event={"ID":"5e1f29ca-f139-4df4-b93a-e567b0d26977","Type":"ContainerStarted","Data":"bfc67ce0da2dc73f317bc6db69bfd4bc445d634d15777426b3b65e96c84fcde0"}
Sep 15 09:45:01.011576 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:01.011455    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-864b9a-29824425-5xg28" event={"ID":"5e1f29ca-f139-4df4-b93a-e567b0d26977","Type":"ContainerStarted","Data":"0df4382c10b5e42c97a110ceeb18afe628be51de341f25a4e8f7d93b1fa81f7f"}
Sep 15 09:45:01.024457 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:01.024414    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b283ee-29824425-fpkfm" podStartSLOduration=1.024399064 podStartE2EDuration="1.024399064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:45:01.022750869 +0000 UTC m=+1864.672166960" watchObservedRunningTime="2026-09-15 09:45:01.024399064 +0000 UTC m=+1864.673815157"
Sep 15 09:45:01.038598 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:01.038557    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-864b9a-29824425-5xg28" podStartSLOduration=1.03854278 podStartE2EDuration="1.03854278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:45:01.036899213 +0000 UTC m=+1864.686315305" watchObservedRunningTime="2026-09-15 09:45:01.03854278 +0000 UTC m=+1864.687958872"
Sep 15 09:45:02.021887 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:02.021857    2575 generic.go:356] "Generic (PLEG): container finished" podID="db452d3b-4345-49f0-ab42-e436f1ea987c" containerID="024d0c4e825cf7c735119e6c665db16f3c7b73feb6c0864c597fc4ab953079c5" exitCode=0
Sep 15 09:45:02.022333 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:02.021945    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b283ee-29824425-fpkfm" event={"ID":"db452d3b-4345-49f0-ab42-e436f1ea987c","Type":"ContainerDied","Data":"024d0c4e825cf7c735119e6c665db16f3c7b73feb6c0864c597fc4ab953079c5"}
Sep 15 09:45:02.023577 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:02.023561    2575 generic.go:356] "Generic (PLEG): container finished" podID="5e1f29ca-f139-4df4-b93a-e567b0d26977" containerID="bfc67ce0da2dc73f317bc6db69bfd4bc445d634d15777426b3b65e96c84fcde0" exitCode=0
Sep 15 09:45:02.023633 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:02.023598    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-864b9a-29824425-5xg28" event={"ID":"5e1f29ca-f139-4df4-b93a-e567b0d26977","Type":"ContainerDied","Data":"bfc67ce0da2dc73f317bc6db69bfd4bc445d634d15777426b3b65e96c84fcde0"}
Sep 15 09:45:03.195918 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:03.195893    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-864b9a-29824425-5xg28"
Sep 15 09:45:03.198853 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:03.198833    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b283ee-29824425-fpkfm"
Sep 15 09:45:04.036415 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:04.036383    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b283ee-29824425-fpkfm"
Sep 15 09:45:04.036630 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:04.036431    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b283ee-29824425-fpkfm" event={"ID":"db452d3b-4345-49f0-ab42-e436f1ea987c","Type":"ContainerDied","Data":"12433a8f254b969d087916566c5ff46ae753ed6176862f5148fa42961b76882a"}
Sep 15 09:45:04.036630 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:04.036481    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12433a8f254b969d087916566c5ff46ae753ed6176862f5148fa42961b76882a"
Sep 15 09:45:04.037833 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:04.037814    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-864b9a-29824425-5xg28"
Sep 15 09:45:04.038033 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:04.037815    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-864b9a-29824425-5xg28" event={"ID":"5e1f29ca-f139-4df4-b93a-e567b0d26977","Type":"ContainerDied","Data":"0df4382c10b5e42c97a110ceeb18afe628be51de341f25a4e8f7d93b1fa81f7f"}
Sep 15 09:45:04.038033 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:04.037976    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0df4382c10b5e42c97a110ceeb18afe628be51de341f25a4e8f7d93b1fa81f7f"
Sep 15 09:45:11.605864 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:11.605817    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:11.706231 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:11.706195    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:21.626096 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:21.626060    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:23.020852 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:23.020820    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:23.260937 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:23.260900    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:23.361360 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:23.361280    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:23.561980 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:23.561947    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:23.673060 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:23.673027    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:26.433473 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:26.433442    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:27.153619 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:27.153577    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:27.244687 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:27.244648    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:27.979026 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:27.978947    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:28.727818 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:28.727757    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:28.817314 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:28.817283    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:29.245358 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.245327    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:29.317441 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.317405    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:29.318160 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.318134    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"]
Sep 15 09:45:29.318592 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.318572    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db452d3b-4345-49f0-ab42-e436f1ea987c" containerName="cleanup"
Sep 15 09:45:29.318729 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.318695    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="db452d3b-4345-49f0-ab42-e436f1ea987c" containerName="cleanup"
Sep 15 09:45:29.318830 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.318747    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e1f29ca-f139-4df4-b93a-e567b0d26977" containerName="cleanup"
Sep 15 09:45:29.318830 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.318757    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e1f29ca-f139-4df4-b93a-e567b0d26977" containerName="cleanup"
Sep 15 09:45:29.318939 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.318906    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e1f29ca-f139-4df4-b93a-e567b0d26977" containerName="cleanup"
Sep 15 09:45:29.318939 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.318925    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="db452d3b-4345-49f0-ab42-e436f1ea987c" containerName="cleanup"
Sep 15 09:45:29.321938 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.321919    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"
Sep 15 09:45:29.324085 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.324067    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-6593fe\""
Sep 15 09:45:29.331862 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.331789    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"]
Sep 15 09:45:29.375004 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.374973    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"]
Sep 15 09:45:29.378566 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.378550    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"
Sep 15 09:45:29.381309 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.381286    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-6593fe-dockercfg-jlhrm\""
Sep 15 09:45:29.390825 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.390801    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"]
Sep 15 09:45:29.452057 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.452021    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cb94919-d5e8-41e3-8d85-07a7dd69e1a4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g\" (UID: \"6cb94919-d5e8-41e3-8d85-07a7dd69e1a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"
Sep 15 09:45:29.452257 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.452085    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xssbw\" (UniqueName: \"kubernetes.io/projected/6cb94919-d5e8-41e3-8d85-07a7dd69e1a4-kube-api-access-xssbw\") pod \"payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g\" (UID: \"6cb94919-d5e8-41e3-8d85-07a7dd69e1a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"
Sep 15 09:45:29.452257 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.452150    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd6cs\" (UniqueName: \"kubernetes.io/projected/bcb73465-99a8-4bc3-847a-24e502574598-kube-api-access-zd6cs\") pod \"payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq\" (UID: \"bcb73465-99a8-4bc3-847a-24e502574598\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"
Sep 15 09:45:29.452257 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.452189    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcb73465-99a8-4bc3-847a-24e502574598-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq\" (UID: \"bcb73465-99a8-4bc3-847a-24e502574598\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"
Sep 15 09:45:29.553347 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.553252    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd6cs\" (UniqueName: \"kubernetes.io/projected/bcb73465-99a8-4bc3-847a-24e502574598-kube-api-access-zd6cs\") pod \"payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq\" (UID: \"bcb73465-99a8-4bc3-847a-24e502574598\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"
Sep 15 09:45:29.553347 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.553311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcb73465-99a8-4bc3-847a-24e502574598-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq\" (UID: \"bcb73465-99a8-4bc3-847a-24e502574598\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"
Sep 15 09:45:29.553585 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.553443    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cb94919-d5e8-41e3-8d85-07a7dd69e1a4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g\" (UID: \"6cb94919-d5e8-41e3-8d85-07a7dd69e1a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"
Sep 15 09:45:29.553585 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.553491    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xssbw\" (UniqueName: \"kubernetes.io/projected/6cb94919-d5e8-41e3-8d85-07a7dd69e1a4-kube-api-access-xssbw\") pod \"payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g\" (UID: \"6cb94919-d5e8-41e3-8d85-07a7dd69e1a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"
Sep 15 09:45:29.554158 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.554130    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcb73465-99a8-4bc3-847a-24e502574598-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq\" (UID: \"bcb73465-99a8-4bc3-847a-24e502574598\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"
Sep 15 09:45:29.554315 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.554293    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cb94919-d5e8-41e3-8d85-07a7dd69e1a4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g\" (UID: \"6cb94919-d5e8-41e3-8d85-07a7dd69e1a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"
Sep 15 09:45:29.562498 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.562474    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xssbw\" (UniqueName: \"kubernetes.io/projected/6cb94919-d5e8-41e3-8d85-07a7dd69e1a4-kube-api-access-xssbw\") pod \"payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g\" (UID: \"6cb94919-d5e8-41e3-8d85-07a7dd69e1a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"
Sep 15 09:45:29.562729 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.562705    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd6cs\" (UniqueName: \"kubernetes.io/projected/bcb73465-99a8-4bc3-847a-24e502574598-kube-api-access-zd6cs\") pod \"payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq\" (UID: \"bcb73465-99a8-4bc3-847a-24e502574598\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"
Sep 15 09:45:29.633497 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.633466    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"
Sep 15 09:45:29.690314 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.690034    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"
Sep 15 09:45:29.904292 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.904260    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"]
Sep 15 09:45:29.905702 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:45:29.905676    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcb73465_99a8_4bc3_847a_24e502574598.slice/crio-26dd1b2c2fa067e9ec1b3cbd690f556d508443f04342ff5810ab3fa0a9f3b34d WatchSource:0}: Error finding container 26dd1b2c2fa067e9ec1b3cbd690f556d508443f04342ff5810ab3fa0a9f3b34d: Status 404 returned error can't find the container with id 26dd1b2c2fa067e9ec1b3cbd690f556d508443f04342ff5810ab3fa0a9f3b34d
Sep 15 09:45:29.983498 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:29.983471    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"]
Sep 15 09:45:29.984969 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:45:29.984941    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cb94919_d5e8_41e3_8d85_07a7dd69e1a4.slice/crio-4634ed74717b01b11aadddf8d3b8b2b84d6ff78a4ffb059184e2d22847919790 WatchSource:0}: Error finding container 4634ed74717b01b11aadddf8d3b8b2b84d6ff78a4ffb059184e2d22847919790: Status 404 returned error can't find the container with id 4634ed74717b01b11aadddf8d3b8b2b84d6ff78a4ffb059184e2d22847919790
Sep 15 09:45:30.185732 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:30.185623    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g" event={"ID":"6cb94919-d5e8-41e3-8d85-07a7dd69e1a4","Type":"ContainerStarted","Data":"4dcd24f7b0058d1a839ee8fac2576bacb1aee6d161f9129427b8a009bdc3c995"}
Sep 15 09:45:30.185732 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:30.185688    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g" event={"ID":"6cb94919-d5e8-41e3-8d85-07a7dd69e1a4","Type":"ContainerStarted","Data":"4634ed74717b01b11aadddf8d3b8b2b84d6ff78a4ffb059184e2d22847919790"}
Sep 15 09:45:30.185732 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:30.185719    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"
Sep 15 09:45:30.187544 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:30.187506    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq" event={"ID":"bcb73465-99a8-4bc3-847a-24e502574598","Type":"ContainerStarted","Data":"bad9784aacbbf5e32d6d31758c31299c0fe691d0c6cf668d406699e48b407761"}
Sep 15 09:45:30.187688 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:30.187554    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq" event={"ID":"bcb73465-99a8-4bc3-847a-24e502574598","Type":"ContainerStarted","Data":"26dd1b2c2fa067e9ec1b3cbd690f556d508443f04342ff5810ab3fa0a9f3b34d"}
Sep 15 09:45:30.187688 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:30.187592    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"
Sep 15 09:45:30.203135 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:30.203087    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g" podStartSLOduration=1.203073125 podStartE2EDuration="1.203073125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:45:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:45:30.201908453 +0000 UTC m=+1893.851324537" watchObservedRunningTime="2026-09-15 09:45:30.203073125 +0000 UTC m=+1893.852489269"
Sep 15 09:45:30.217657 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:30.217614    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq" podStartSLOduration=1.217598801 podStartE2EDuration="1.217598801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:45:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:45:30.215485944 +0000 UTC m=+1893.864902038" watchObservedRunningTime="2026-09-15 09:45:30.217598801 +0000 UTC m=+1893.867014893"
Sep 15 09:45:41.195348 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:41.195315    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"
Sep 15 09:45:41.195813 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:41.195542    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"
Sep 15 09:45:44.199919 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:44.199886    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:50.722020 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:50.721987    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:51.353575 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:51.353541    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:52.785823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:52.785780    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:52.881927 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:52.881890    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:53.147939 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.147902    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"]
Sep 15 09:45:53.153313 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.153293    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.156370 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.156346    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-527142-openshift-default-dockercfg-2p5fh\""
Sep 15 09:45:53.168897 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.168864    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-istio-data\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.169030 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.168943    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-workload-certs\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.169030 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.168975    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70359691-c652-491e-8de0-7c71b3e58811-istio-token\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.169030 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.169012    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-workload-socket\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.169206 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.169050    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-istio-envoy\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.169206 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.169082    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l54v\" (UniqueName: \"kubernetes.io/projected/70359691-c652-491e-8de0-7c71b3e58811-kube-api-access-5l54v\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.169206 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.169151    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70359691-c652-491e-8de0-7c71b3e58811-istio-podinfo\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.169401 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.169214    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-credential-socket\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.169401 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.169268    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70359691-c652-491e-8de0-7c71b3e58811-istiod-ca-cert\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.171714 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.171690    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"]
Sep 15 09:45:53.181259 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.181232    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:53.270605 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.270573    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-credential-socket\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.270823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.270617    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70359691-c652-491e-8de0-7c71b3e58811-istiod-ca-cert\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.270823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.270642    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-istio-data\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.270823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.270673    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-workload-certs\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.270823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.270692    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70359691-c652-491e-8de0-7c71b3e58811-istio-token\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.270823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.270710    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-workload-socket\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.270823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.270731    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-istio-envoy\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.270823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.270747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l54v\" (UniqueName: \"kubernetes.io/projected/70359691-c652-491e-8de0-7c71b3e58811-kube-api-access-5l54v\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.270823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.270820    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70359691-c652-491e-8de0-7c71b3e58811-istio-podinfo\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.271268 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.271067    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-credential-socket\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.271268 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.271164    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-workload-certs\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.271268 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.271245    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-istio-data\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.271421 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.271365    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-workload-socket\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.271512 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.271494    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70359691-c652-491e-8de0-7c71b3e58811-istiod-ca-cert\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.273358 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.273335    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-istio-envoy\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.273455 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.273376    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70359691-c652-491e-8de0-7c71b3e58811-istio-podinfo\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.278255 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.278231    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l54v\" (UniqueName: \"kubernetes.io/projected/70359691-c652-491e-8de0-7c71b3e58811-kube-api-access-5l54v\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.278341 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.278256    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70359691-c652-491e-8de0-7c71b3e58811-istio-token\") pod \"e2e-ipp-b-527142-openshift-default-665f987454-6r4fq\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") " pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.472430 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.472335    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:53.480521 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.480492    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:53.746816 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.746789    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"]
Sep 15 09:45:53.749282 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:45:53.749247    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70359691_c652_491e_8de0_7c71b3e58811.slice/crio-343f808af27dfbba9b402e36df040d1a37b512cbb2aae96d22c648479d9faf0a WatchSource:0}: Error finding container 343f808af27dfbba9b402e36df040d1a37b512cbb2aae96d22c648479d9faf0a: Status 404 returned error can't find the container with id 343f808af27dfbba9b402e36df040d1a37b512cbb2aae96d22c648479d9faf0a
Sep 15 09:45:53.751527 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.751493    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:45:53.751619 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.751565    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:45:53.751619 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:53.751592    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:45:54.319028 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:54.318988    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq" event={"ID":"70359691-c652-491e-8de0-7c71b3e58811","Type":"ContainerStarted","Data":"3a8f236acfec7226a02def8a58edfb208305c766f7003cf2d0674655e304f407"}
Sep 15 09:45:54.319409 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:54.319051    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq" event={"ID":"70359691-c652-491e-8de0-7c71b3e58811","Type":"ContainerStarted","Data":"343f808af27dfbba9b402e36df040d1a37b512cbb2aae96d22c648479d9faf0a"}
Sep 15 09:45:54.339638 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:54.339585    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq" podStartSLOduration=1.339570443 podStartE2EDuration="1.339570443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:45:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:45:54.33751194 +0000 UTC m=+1917.986928034" watchObservedRunningTime="2026-09-15 09:45:54.339570443 +0000 UTC m=+1917.988986535"
Sep 15 09:45:54.472923 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:54.472891    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:54.478258 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:54.478234    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:55.326441 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:55.326398    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:55.327865 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:55.327836    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:45:55.639286 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:55.639252    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:56.313226 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:56.313193    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:56.406010 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:56.405983    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:57.034607 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:57.034566    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:57.814327 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:57.814291    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:58.634278 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:58.634247    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:58.734821 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:58.734749    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:58.838622 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:58.838584    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:59.176963 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:59.176936    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:45:59.282292 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:45:59.282262    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:46:14.443536 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:14.443503    2575 generic.go:356] "Generic (PLEG): container finished" podID="70359691-c652-491e-8de0-7c71b3e58811" containerID="3a8f236acfec7226a02def8a58edfb208305c766f7003cf2d0674655e304f407" exitCode=0
Sep 15 09:46:14.443957 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:14.443570    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq" event={"ID":"70359691-c652-491e-8de0-7c71b3e58811","Type":"ContainerDied","Data":"3a8f236acfec7226a02def8a58edfb208305c766f7003cf2d0674655e304f407"}
Sep 15 09:46:14.444005 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:14.443972    2575 scope.go:117] "RemoveContainer" containerID="3a8f236acfec7226a02def8a58edfb208305c766f7003cf2d0674655e304f407"
Sep 15 09:46:14.445091 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:14.445059    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:46:14.445203 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:14.445131    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:46:14.445203 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:14.445161    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:46:15.455309 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:15.455261    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq" event={"ID":"70359691-c652-491e-8de0-7c71b3e58811","Type":"ContainerStarted","Data":"b77620affdb741a6f4563d3d8d5a20483ac486c8798bce48a5248055b725aed1"}
Sep 15 09:46:15.473496 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:15.473454    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:46:15.473898 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:15.473870    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 15 09:46:15.473983 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:15.473943    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq" podUID="70359691-c652-491e-8de0-7c71b3e58811" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 15 09:46:16.473227 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:16.473196    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 15 09:46:16.473675 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:16.473248    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq" podUID="70359691-c652-491e-8de0-7c71b3e58811" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 15 09:46:17.473075 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:17.473040    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 15 09:46:17.473263 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:17.473097    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq" podUID="70359691-c652-491e-8de0-7c71b3e58811" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 15 09:46:18.473463 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:18.473423    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 15 09:46:18.473906 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:18.473483    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq" podUID="70359691-c652-491e-8de0-7c71b3e58811" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 15 09:46:19.472923 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:19.472882    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 15 09:46:19.473106 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:19.472957    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq" podUID="70359691-c652-491e-8de0-7c71b3e58811" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 15 09:46:20.652395 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:20.652357    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:46:20.652943 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:20.652735    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:46:20.653517 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:20.653500    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:46:20.729923 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:20.729889    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:46:21.302723 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:21.302689    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:46:21.601720 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:21.601635    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:46:22.200904 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:22.200850    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:46:22.842055 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:22.842013    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:46:23.534006 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:23.533966    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:46:26.492533 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:26.492508    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pljbs_9fcbe6bc-94d4-4557-bb35-1e664c775fa0/payload-processing/0.log"
Sep 15 09:46:38.745852 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:38.745825    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:46:38.801515 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:38.801489    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:46:47.231401 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:47.231366    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:46:47.285288 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:47.285253    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:46:53.724837 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:53.724723    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:46:57.187484 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:57.187448    2575 scope.go:117] "RemoveContainer" containerID="1728fd44bbf028ab9a34170b3574673e19cebecd36d1b65327cb64be02477304"
Sep 15 09:46:57.196626 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:46:57.196605    2575 scope.go:117] "RemoveContainer" containerID="2573b33a0a45e0b048aef6e354e858fc3a01f246129ded920bb981e70c0602e8"
Sep 15 09:47:11.484247 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:11.484212    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:11.556343 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:11.556309    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:14.998070 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:14.998036    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:28.142985 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:28.142945    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g_6cb94919-d5e8-41e3-8d85-07a7dd69e1a4/payload-processing/0.log"
Sep 15 09:47:28.301425 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:28.301390    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pljbs_9fcbe6bc-94d4-4557-bb35-1e664c775fa0/payload-processing/0.log"
Sep 15 09:47:28.742791 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:28.742723    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:29.046196 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.046113    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"]
Sep 15 09:47:29.050392 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.050370    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.052722 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.052701    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-29a3ae-openshift-default-dockercfg-rmsk8\""
Sep 15 09:47:29.062050 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.062024    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"]
Sep 15 09:47:29.072380 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.072352    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxxpc\" (UniqueName: \"kubernetes.io/projected/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-kube-api-access-vxxpc\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.072540 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.072391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-data\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.072540 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.072435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-envoy\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.072540 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.072466    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-workload-certs\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.072540 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.072491    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-podinfo\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.072822 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.072547    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-workload-socket\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.072822 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.072594    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istiod-ca-cert\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.072822 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.072622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-token\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.072822 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.072689    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-credential-socket\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.079380 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.079352    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:29.173937 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.173896    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-workload-certs\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.174400 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.173948    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-podinfo\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.174400 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.173967    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-workload-socket\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.174400 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.173993    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istiod-ca-cert\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.174400 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.174015    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-token\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.174400 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.174036    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-credential-socket\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.174400 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.174071    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxxpc\" (UniqueName: \"kubernetes.io/projected/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-kube-api-access-vxxpc\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.174400 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.174105    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-data\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.174400 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.174147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-envoy\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.174400 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.174377    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-workload-certs\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.174827 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.174585    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-workload-socket\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.174827 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.174631    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-credential-socket\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.174827 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.174645    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-data\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.175034 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.175013    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istiod-ca-cert\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.176639 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.176611    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-envoy\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.176742 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.176699    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-podinfo\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.188087 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.188057    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-token\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.188186 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.188131    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxxpc\" (UniqueName: \"kubernetes.io/projected/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-kube-api-access-vxxpc\") pod \"e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") " pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.215167 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.215140    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:29.361718 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.361634    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:29.641697 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.641670    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"]
Sep 15 09:47:29.643907 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:47:29.643881    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d1fe25_66ae_46fa_a683_3e3d58bb33b7.slice/crio-89e9e9b8989fc72e0a58bd298c6f4244f530c9584a2bd66fda0197dc18833eb0 WatchSource:0}: Error finding container 89e9e9b8989fc72e0a58bd298c6f4244f530c9584a2bd66fda0197dc18833eb0: Status 404 returned error can't find the container with id 89e9e9b8989fc72e0a58bd298c6f4244f530c9584a2bd66fda0197dc18833eb0
Sep 15 09:47:29.646713 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.646682    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:47:29.646828 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.646748    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:47:29.646828 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.646797    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:47:29.880503 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.880461    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4" event={"ID":"65d1fe25-66ae-46fa-a683-3e3d58bb33b7","Type":"ContainerStarted","Data":"e91dcdc187e0dd98c0cd2cd628141e75262fe1dc44182585b540f39789e453e8"}
Sep 15 09:47:29.880705 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.880527    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4" event={"ID":"65d1fe25-66ae-46fa-a683-3e3d58bb33b7","Type":"ContainerStarted","Data":"89e9e9b8989fc72e0a58bd298c6f4244f530c9584a2bd66fda0197dc18833eb0"}
Sep 15 09:47:29.899871 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:29.899735    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4" podStartSLOduration=0.899713282 podStartE2EDuration="899.713282ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:47:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:47:29.899256029 +0000 UTC m=+2013.548672135" watchObservedRunningTime="2026-09-15 09:47:29.899713282 +0000 UTC m=+2013.549129376"
Sep 15 09:47:30.362647 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:30.362559    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:30.367779 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:30.367739    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:30.886879 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:30.886840    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:30.887845 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:30.887821    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:31.369882 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:31.369795    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:31.892274 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:31.892230    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:32.005276 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:32.005233    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:32.142676 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:32.142580    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:32.934780 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:32.934733    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:33.632030 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:33.631990    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:34.445211 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:34.445178    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:35.131081 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:35.131050    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:35.231173 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:35.231119    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:35.286186 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:35.286159    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:35.598676 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:35.598643    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:35.684527 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:35.684496    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:35.738100 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:35.738071    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"]
Sep 15 09:47:35.742249 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:35.742221    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"
Sep 15 09:47:35.745706 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:35.745681    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-29a3ae-dockercfg-p4wws\""
Sep 15 09:47:35.746011 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:35.745993    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-29a3ae\""
Sep 15 09:47:35.757684 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:35.757658    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"]
Sep 15 09:47:35.841309 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:35.841273    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71915e54-b9c6-4c5a-b1b4-1bb0834a76f3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58\" (UID: \"71915e54-b9c6-4c5a-b1b4-1bb0834a76f3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"
Sep 15 09:47:35.841593 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:35.841570    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jprs7\" (UniqueName: \"kubernetes.io/projected/71915e54-b9c6-4c5a-b1b4-1bb0834a76f3-kube-api-access-jprs7\") pod \"payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58\" (UID: \"71915e54-b9c6-4c5a-b1b4-1bb0834a76f3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"
Sep 15 09:47:35.943473 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:35.943427    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71915e54-b9c6-4c5a-b1b4-1bb0834a76f3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58\" (UID: \"71915e54-b9c6-4c5a-b1b4-1bb0834a76f3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"
Sep 15 09:47:35.943692 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:35.943505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jprs7\" (UniqueName: \"kubernetes.io/projected/71915e54-b9c6-4c5a-b1b4-1bb0834a76f3-kube-api-access-jprs7\") pod \"payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58\" (UID: \"71915e54-b9c6-4c5a-b1b4-1bb0834a76f3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"
Sep 15 09:47:35.944384 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:35.944355    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71915e54-b9c6-4c5a-b1b4-1bb0834a76f3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58\" (UID: \"71915e54-b9c6-4c5a-b1b4-1bb0834a76f3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"
Sep 15 09:47:35.953465 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:35.953437    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jprs7\" (UniqueName: \"kubernetes.io/projected/71915e54-b9c6-4c5a-b1b4-1bb0834a76f3-kube-api-access-jprs7\") pod \"payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58\" (UID: \"71915e54-b9c6-4c5a-b1b4-1bb0834a76f3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"
Sep 15 09:47:36.055479 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:36.055441    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"
Sep 15 09:47:36.328657 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:36.328630    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"]
Sep 15 09:47:36.330886 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:47:36.330857    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71915e54_b9c6_4c5a_b1b4_1bb0834a76f3.slice/crio-1d219a68ce2ba00ebad365923cff3617d16ac4293241b9f5f177f86f27cb67b4 WatchSource:0}: Error finding container 1d219a68ce2ba00ebad365923cff3617d16ac4293241b9f5f177f86f27cb67b4: Status 404 returned error can't find the container with id 1d219a68ce2ba00ebad365923cff3617d16ac4293241b9f5f177f86f27cb67b4
Sep 15 09:47:36.922472 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:36.922435    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58" event={"ID":"71915e54-b9c6-4c5a-b1b4-1bb0834a76f3","Type":"ContainerStarted","Data":"0114e44695807ab0fb5ad40365dbdbc0254f536ddaa3979f7c985ace60f4bc03"}
Sep 15 09:47:36.922901 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:36.922502    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58" event={"ID":"71915e54-b9c6-4c5a-b1b4-1bb0834a76f3","Type":"ContainerStarted","Data":"1d219a68ce2ba00ebad365923cff3617d16ac4293241b9f5f177f86f27cb67b4"}
Sep 15 09:47:36.922901 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:36.922619    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"
Sep 15 09:47:36.938955 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:36.938910    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58" podStartSLOduration=1.938895824 podStartE2EDuration="1.938895824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:47:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:47:36.936799714 +0000 UTC m=+2020.586215811" watchObservedRunningTime="2026-09-15 09:47:36.938895824 +0000 UTC m=+2020.588311917"
Sep 15 09:47:43.438141 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:43.438092    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:47.930342 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:47.930312    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"
Sep 15 09:47:52.016402 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:52.016366    2575 generic.go:356] "Generic (PLEG): container finished" podID="65d1fe25-66ae-46fa-a683-3e3d58bb33b7" containerID="e91dcdc187e0dd98c0cd2cd628141e75262fe1dc44182585b540f39789e453e8" exitCode=0
Sep 15 09:47:52.016951 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:52.016444    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4" event={"ID":"65d1fe25-66ae-46fa-a683-3e3d58bb33b7","Type":"ContainerDied","Data":"e91dcdc187e0dd98c0cd2cd628141e75262fe1dc44182585b540f39789e453e8"}
Sep 15 09:47:52.017031 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:52.016981    2575 scope.go:117] "RemoveContainer" containerID="e91dcdc187e0dd98c0cd2cd628141e75262fe1dc44182585b540f39789e453e8"
Sep 15 09:47:52.018192 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:52.018159    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:47:52.018292 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:52.018228    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:47:52.018292 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:52.018273    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:47:53.024716 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:53.024673    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4" event={"ID":"65d1fe25-66ae-46fa-a683-3e3d58bb33b7","Type":"ContainerStarted","Data":"5617401a7d1c2027474e604b96a6fafd9c07edb858ddb3a60ea2dc829c87d227"}
Sep 15 09:47:53.362134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:53.362041    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:53.362322 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:53.362260    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 15 09:47:53.362403 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:53.362314    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4" podUID="65d1fe25-66ae-46fa-a683-3e3d58bb33b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 15 09:47:54.363150 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:54.362532    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 15 09:47:54.363150 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:54.362660    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4" podUID="65d1fe25-66ae-46fa-a683-3e3d58bb33b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 15 09:47:55.362144 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:55.362102    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 15 09:47:55.362470 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:55.362437    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4" podUID="65d1fe25-66ae-46fa-a683-3e3d58bb33b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 15 09:47:56.189662 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:56.189604    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:56.362355 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:56.362308    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 15 09:47:56.362573 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:56.362413    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4" podUID="65d1fe25-66ae-46fa-a683-3e3d58bb33b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 15 09:47:57.221363 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:57.221325    2575 scope.go:117] "RemoveContainer" containerID="c9fc3ad213259daa667b5c68a6f6013d643962af4ded9c481240abfa596f69ea"
Sep 15 09:47:57.230633 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:57.230610    2575 scope.go:117] "RemoveContainer" containerID="24062eb927cbb225c775001c2516e4c630786f304182071fbdcc51cda3fb8380"
Sep 15 09:47:57.363386 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:57.362925    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 15 09:47:57.363386 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:57.362998    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4" podUID="65d1fe25-66ae-46fa-a683-3e3d58bb33b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 15 09:47:57.923002 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:57.922961    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:58.363191 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:58.363070    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 15 09:47:58.363720 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:58.363179    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4" podUID="65d1fe25-66ae-46fa-a683-3e3d58bb33b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 15 09:47:58.739600 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:58.739568    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:47:59.452936 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:59.452878    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:59.453545 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:59.453526    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:59.462952 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:59.455717    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:47:59.558899 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:47:59.558864    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:00.232887 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:00.232856    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:01.041109 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:01.041076    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:01.823281 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:01.823250    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:02.047102 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:02.047068    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:02.727323 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:02.727284    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg"]
Sep 15 09:48:02.730547 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:02.730519    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg"
Sep 15 09:48:02.732926 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:02.732901    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:48:02.737841 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:02.737815    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg"]
Sep 15 09:48:02.824070 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:02.824034    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4950d79-57c1-4e0d-b416-24f9006c80a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg\" (UID: \"b4950d79-57c1-4e0d-b416-24f9006c80a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg"
Sep 15 09:48:02.924543 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:02.924500    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4950d79-57c1-4e0d-b416-24f9006c80a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg\" (UID: \"b4950d79-57c1-4e0d-b416-24f9006c80a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg"
Sep 15 09:48:02.925099 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:02.925077    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4950d79-57c1-4e0d-b416-24f9006c80a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg\" (UID: \"b4950d79-57c1-4e0d-b416-24f9006c80a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg"
Sep 15 09:48:03.042854 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:03.042738    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg"
Sep 15 09:48:03.317563 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:03.317535    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg"]
Sep 15 09:48:03.319543 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:48:03.319515    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4950d79_57c1_4e0d_b416_24f9006c80a1.slice/crio-8de4090b8053956082c652a96e9e79a847aece17c80946956bcc00324512b9e1 WatchSource:0}: Error finding container 8de4090b8053956082c652a96e9e79a847aece17c80946956bcc00324512b9e1: Status 404 returned error can't find the container with id 8de4090b8053956082c652a96e9e79a847aece17c80946956bcc00324512b9e1
Sep 15 09:48:03.525782 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:03.525729    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:04.102548 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:04.102517    2575 generic.go:356] "Generic (PLEG): container finished" podID="b4950d79-57c1-4e0d-b416-24f9006c80a1" containerID="d3af8eb44c0dd4bbfd4990191ef3d1b258c952756920e79da22488d88a7de579" exitCode=0
Sep 15 09:48:04.102672 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:04.102595    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg" event={"ID":"b4950d79-57c1-4e0d-b416-24f9006c80a1","Type":"ContainerDied","Data":"d3af8eb44c0dd4bbfd4990191ef3d1b258c952756920e79da22488d88a7de579"}
Sep 15 09:48:04.102672 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:04.102641    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg" event={"ID":"b4950d79-57c1-4e0d-b416-24f9006c80a1","Type":"ContainerStarted","Data":"8de4090b8053956082c652a96e9e79a847aece17c80946956bcc00324512b9e1"}
Sep 15 09:48:04.354823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:04.354704    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:05.262015 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:05.261986    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg"
Sep 15 09:48:05.310409 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:05.310361    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:05.347701 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:05.347672    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4950d79-57c1-4e0d-b416-24f9006c80a1-maas-api-service-ca\") pod \"b4950d79-57c1-4e0d-b416-24f9006c80a1\" (UID: \"b4950d79-57c1-4e0d-b416-24f9006c80a1\") "
Sep 15 09:48:05.348055 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:05.348032    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4950d79-57c1-4e0d-b416-24f9006c80a1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b4950d79-57c1-4e0d-b416-24f9006c80a1" (UID: "b4950d79-57c1-4e0d-b416-24f9006c80a1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:48:05.448951 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:05.448917    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4950d79-57c1-4e0d-b416-24f9006c80a1-maas-api-service-ca\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:48:06.116890 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:06.116857    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg"
Sep 15 09:48:06.116890 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:06.116879    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg" event={"ID":"b4950d79-57c1-4e0d-b416-24f9006c80a1","Type":"ContainerDied","Data":"8de4090b8053956082c652a96e9e79a847aece17c80946956bcc00324512b9e1"}
Sep 15 09:48:06.117108 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:06.116922    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8de4090b8053956082c652a96e9e79a847aece17c80946956bcc00324512b9e1"
Sep 15 09:48:06.565064 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:06.565034    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:07.370069 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:07.370038    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:08.380234 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:08.380202    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:13.649845 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:13.649785    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:13.710222 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:13.710191    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"]
Sep 15 09:48:13.710436 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:13.710410    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58" podUID="71915e54-b9c6-4c5a-b1b4-1bb0834a76f3" containerName="payload-processing" containerID="cri-o://0114e44695807ab0fb5ad40365dbdbc0254f536ddaa3979f7c985ace60f4bc03" gracePeriod=30
Sep 15 09:48:13.771882 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:13.771849    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:13.863250 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:13.863216    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:13.940005 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:13.939929    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg"]
Sep 15 09:48:13.947013 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:13.946983    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-29a3ae-27gpg"]
Sep 15 09:48:13.953355 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:13.953327    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:13.978336 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:13.978316    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"
Sep 15 09:48:14.030105 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.030058    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jprs7\" (UniqueName: \"kubernetes.io/projected/71915e54-b9c6-4c5a-b1b4-1bb0834a76f3-kube-api-access-jprs7\") pod \"71915e54-b9c6-4c5a-b1b4-1bb0834a76f3\" (UID: \"71915e54-b9c6-4c5a-b1b4-1bb0834a76f3\") "
Sep 15 09:48:14.030465 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.030444    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71915e54-b9c6-4c5a-b1b4-1bb0834a76f3-plugins-config-volume\") pod \"71915e54-b9c6-4c5a-b1b4-1bb0834a76f3\" (UID: \"71915e54-b9c6-4c5a-b1b4-1bb0834a76f3\") "
Sep 15 09:48:14.030960 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.030931    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71915e54-b9c6-4c5a-b1b4-1bb0834a76f3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "71915e54-b9c6-4c5a-b1b4-1bb0834a76f3" (UID: "71915e54-b9c6-4c5a-b1b4-1bb0834a76f3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:48:14.031198 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.031168    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71915e54-b9c6-4c5a-b1b4-1bb0834a76f3-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:48:14.033757 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.033384    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71915e54-b9c6-4c5a-b1b4-1bb0834a76f3-kube-api-access-jprs7" (OuterVolumeSpecName: "kube-api-access-jprs7") pod "71915e54-b9c6-4c5a-b1b4-1bb0834a76f3" (UID: "71915e54-b9c6-4c5a-b1b4-1bb0834a76f3"). InnerVolumeSpecName "kube-api-access-jprs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:48:14.132225 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.132192    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jprs7\" (UniqueName: \"kubernetes.io/projected/71915e54-b9c6-4c5a-b1b4-1bb0834a76f3-kube-api-access-jprs7\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:48:14.166720 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.166680    2575 generic.go:356] "Generic (PLEG): container finished" podID="71915e54-b9c6-4c5a-b1b4-1bb0834a76f3" containerID="0114e44695807ab0fb5ad40365dbdbc0254f536ddaa3979f7c985ace60f4bc03" exitCode=0
Sep 15 09:48:14.166915 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.166734    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"
Sep 15 09:48:14.166915 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.166806    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58" event={"ID":"71915e54-b9c6-4c5a-b1b4-1bb0834a76f3","Type":"ContainerDied","Data":"0114e44695807ab0fb5ad40365dbdbc0254f536ddaa3979f7c985ace60f4bc03"}
Sep 15 09:48:14.166915 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.166859    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58" event={"ID":"71915e54-b9c6-4c5a-b1b4-1bb0834a76f3","Type":"ContainerDied","Data":"1d219a68ce2ba00ebad365923cff3617d16ac4293241b9f5f177f86f27cb67b4"}
Sep 15 09:48:14.166915 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.166881    2575 scope.go:117] "RemoveContainer" containerID="0114e44695807ab0fb5ad40365dbdbc0254f536ddaa3979f7c985ace60f4bc03"
Sep 15 09:48:14.176270 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.176253    2575 scope.go:117] "RemoveContainer" containerID="0114e44695807ab0fb5ad40365dbdbc0254f536ddaa3979f7c985ace60f4bc03"
Sep 15 09:48:14.176531 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:48:14.176512    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0114e44695807ab0fb5ad40365dbdbc0254f536ddaa3979f7c985ace60f4bc03\": container with ID starting with 0114e44695807ab0fb5ad40365dbdbc0254f536ddaa3979f7c985ace60f4bc03 not found: ID does not exist" containerID="0114e44695807ab0fb5ad40365dbdbc0254f536ddaa3979f7c985ace60f4bc03"
Sep 15 09:48:14.176579 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.176540    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0114e44695807ab0fb5ad40365dbdbc0254f536ddaa3979f7c985ace60f4bc03"} err="failed to get container status \"0114e44695807ab0fb5ad40365dbdbc0254f536ddaa3979f7c985ace60f4bc03\": rpc error: code = NotFound desc = could not find container \"0114e44695807ab0fb5ad40365dbdbc0254f536ddaa3979f7c985ace60f4bc03\": container with ID starting with 0114e44695807ab0fb5ad40365dbdbc0254f536ddaa3979f7c985ace60f4bc03 not found: ID does not exist"
Sep 15 09:48:14.191892 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.191843    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"]
Sep 15 09:48:14.197488 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.197468    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-29a3ae-7c96ccf8f7-b4c58"]
Sep 15 09:48:14.452503 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.452418    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:14.566970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.566941    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:14.860673 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.860602    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71915e54-b9c6-4c5a-b1b4-1bb0834a76f3" path="/var/lib/kubelet/pods/71915e54-b9c6-4c5a-b1b4-1bb0834a76f3/volumes"
Sep 15 09:48:14.861034 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:14.860964    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4950d79-57c1-4e0d-b416-24f9006c80a1" path="/var/lib/kubelet/pods/b4950d79-57c1-4e0d-b416-24f9006c80a1/volumes"
Sep 15 09:48:15.440660 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:15.440620    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:16.692178 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:16.692136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:17.881730 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:17.881641    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:19.438315 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:19.438283    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:22.118536 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:22.118497    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:22.267318 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:22.267267    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:22.458067 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:22.458031    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"]
Sep 15 09:48:22.458304 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:22.458277    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4" podUID="65d1fe25-66ae-46fa-a683-3e3d58bb33b7" containerName="istio-proxy" containerID="cri-o://5617401a7d1c2027474e604b96a6fafd9c07edb858ddb3a60ea2dc829c87d227" gracePeriod=30
Sep 15 09:48:22.481685 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:22.481652    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:26.399535 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:26.399501    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n"]
Sep 15 09:48:26.399990 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:26.399973    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71915e54-b9c6-4c5a-b1b4-1bb0834a76f3" containerName="payload-processing"
Sep 15 09:48:26.400042 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:26.399994    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="71915e54-b9c6-4c5a-b1b4-1bb0834a76f3" containerName="payload-processing"
Sep 15 09:48:26.400042 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:26.400024    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4950d79-57c1-4e0d-b416-24f9006c80a1" containerName="revoke-keys"
Sep 15 09:48:26.400042 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:26.400030    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4950d79-57c1-4e0d-b416-24f9006c80a1" containerName="revoke-keys"
Sep 15 09:48:26.400146 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:26.400121    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4950d79-57c1-4e0d-b416-24f9006c80a1" containerName="revoke-keys"
Sep 15 09:48:26.400146 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:26.400130    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="71915e54-b9c6-4c5a-b1b4-1bb0834a76f3" containerName="payload-processing"
Sep 15 09:48:26.404698 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:26.404679    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n"
Sep 15 09:48:26.408301 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:26.408283    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:48:26.418455 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:26.418434    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n"]
Sep 15 09:48:26.550479 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:26.550435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd167ac-c3c2-4b68-9c51-3fcad49f9abf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n\" (UID: \"5dd167ac-c3c2-4b68-9c51-3fcad49f9abf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n"
Sep 15 09:48:26.605744 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:26.605710    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:26.652096 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:26.651855    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd167ac-c3c2-4b68-9c51-3fcad49f9abf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n\" (UID: \"5dd167ac-c3c2-4b68-9c51-3fcad49f9abf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n"
Sep 15 09:48:26.652707 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:26.652671    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd167ac-c3c2-4b68-9c51-3fcad49f9abf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n\" (UID: \"5dd167ac-c3c2-4b68-9c51-3fcad49f9abf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n"
Sep 15 09:48:26.714888 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:26.714860    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n"
Sep 15 09:48:26.994179 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:26.994156    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n"]
Sep 15 09:48:26.996629 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:48:26.996603    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd167ac_c3c2_4b68_9c51_3fcad49f9abf.slice/crio-4e9c5c8c556d962373d1d31ced7ecd221004685a78566d30bbea713e8bf3d4ee WatchSource:0}: Error finding container 4e9c5c8c556d962373d1d31ced7ecd221004685a78566d30bbea713e8bf3d4ee: Status 404 returned error can't find the container with id 4e9c5c8c556d962373d1d31ced7ecd221004685a78566d30bbea713e8bf3d4ee
Sep 15 09:48:27.241017 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.240982    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n" event={"ID":"5dd167ac-c3c2-4b68-9c51-3fcad49f9abf","Type":"ContainerStarted","Data":"4e9c5c8c556d962373d1d31ced7ecd221004685a78566d30bbea713e8bf3d4ee"}
Sep 15 09:48:27.699685 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.699658    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:48:27.851954 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.851881    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:27.864013 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.863987    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istiod-ca-cert\") pod \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") "
Sep 15 09:48:27.864188 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.864031    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-credential-socket\") pod \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") "
Sep 15 09:48:27.864188 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.864080    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxxpc\" (UniqueName: \"kubernetes.io/projected/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-kube-api-access-vxxpc\") pod \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") "
Sep 15 09:48:27.864188 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.864121    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-workload-socket\") pod \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") "
Sep 15 09:48:27.864188 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.864153    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-envoy\") pod \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") "
Sep 15 09:48:27.864188 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.864178    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-podinfo\") pod \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") "
Sep 15 09:48:27.864446 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.864209    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-workload-certs\") pod \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") "
Sep 15 09:48:27.864446 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.864298    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-data\") pod \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") "
Sep 15 09:48:27.864446 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.864366    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-token\") pod \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\" (UID: \"65d1fe25-66ae-46fa-a683-3e3d58bb33b7\") "
Sep 15 09:48:27.864584 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.864455    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "65d1fe25-66ae-46fa-a683-3e3d58bb33b7" (UID: "65d1fe25-66ae-46fa-a683-3e3d58bb33b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:48:27.864584 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.864482    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "65d1fe25-66ae-46fa-a683-3e3d58bb33b7" (UID: "65d1fe25-66ae-46fa-a683-3e3d58bb33b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:48:27.864702 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.864662    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "65d1fe25-66ae-46fa-a683-3e3d58bb33b7" (UID: "65d1fe25-66ae-46fa-a683-3e3d58bb33b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:48:27.864795 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.864704    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "65d1fe25-66ae-46fa-a683-3e3d58bb33b7" (UID: "65d1fe25-66ae-46fa-a683-3e3d58bb33b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:48:27.864795 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.864726    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istiod-ca-cert\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:48:27.864795 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.864744    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-credential-socket\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:48:27.864795 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.864756    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "65d1fe25-66ae-46fa-a683-3e3d58bb33b7" (UID: "65d1fe25-66ae-46fa-a683-3e3d58bb33b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:48:27.866674 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.866647    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "65d1fe25-66ae-46fa-a683-3e3d58bb33b7" (UID: "65d1fe25-66ae-46fa-a683-3e3d58bb33b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:48:27.866813 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.866792    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "65d1fe25-66ae-46fa-a683-3e3d58bb33b7" (UID: "65d1fe25-66ae-46fa-a683-3e3d58bb33b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:48:27.866870 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.866822    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-kube-api-access-vxxpc" (OuterVolumeSpecName: "kube-api-access-vxxpc") pod "65d1fe25-66ae-46fa-a683-3e3d58bb33b7" (UID: "65d1fe25-66ae-46fa-a683-3e3d58bb33b7"). InnerVolumeSpecName "kube-api-access-vxxpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:48:27.866870 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.866816    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "65d1fe25-66ae-46fa-a683-3e3d58bb33b7" (UID: "65d1fe25-66ae-46fa-a683-3e3d58bb33b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:48:27.965562 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.965531    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxxpc\" (UniqueName: \"kubernetes.io/projected/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-kube-api-access-vxxpc\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:48:27.965562 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.965562    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-workload-socket\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:48:27.965756 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.965575    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-envoy\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:48:27.965756 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.965588    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-podinfo\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:48:27.965756 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.965600    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-workload-certs\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:48:27.965756 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.965611    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-data\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:48:27.965756 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:27.965621    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65d1fe25-66ae-46fa-a683-3e3d58bb33b7-istio-token\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:48:28.250092 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:28.250058    2575 generic.go:356] "Generic (PLEG): container finished" podID="65d1fe25-66ae-46fa-a683-3e3d58bb33b7" containerID="5617401a7d1c2027474e604b96a6fafd9c07edb858ddb3a60ea2dc829c87d227" exitCode=0
Sep 15 09:48:28.250295 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:28.250129    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"
Sep 15 09:48:28.250295 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:28.250152    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4" event={"ID":"65d1fe25-66ae-46fa-a683-3e3d58bb33b7","Type":"ContainerDied","Data":"5617401a7d1c2027474e604b96a6fafd9c07edb858ddb3a60ea2dc829c87d227"}
Sep 15 09:48:28.250295 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:28.250226    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4" event={"ID":"65d1fe25-66ae-46fa-a683-3e3d58bb33b7","Type":"ContainerDied","Data":"89e9e9b8989fc72e0a58bd298c6f4244f530c9584a2bd66fda0197dc18833eb0"}
Sep 15 09:48:28.250295 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:28.250247    2575 scope.go:117] "RemoveContainer" containerID="5617401a7d1c2027474e604b96a6fafd9c07edb858ddb3a60ea2dc829c87d227"
Sep 15 09:48:28.252202 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:28.252166    2575 generic.go:356] "Generic (PLEG): container finished" podID="5dd167ac-c3c2-4b68-9c51-3fcad49f9abf" containerID="ecb7fe7c9cc13744af3c93f1a5e19a9e027f1155ae735646f72f6b5f5a0e019c" exitCode=0
Sep 15 09:48:28.252331 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:28.252211    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n" event={"ID":"5dd167ac-c3c2-4b68-9c51-3fcad49f9abf","Type":"ContainerDied","Data":"ecb7fe7c9cc13744af3c93f1a5e19a9e027f1155ae735646f72f6b5f5a0e019c"}
Sep 15 09:48:28.260813 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:28.260790    2575 scope.go:117] "RemoveContainer" containerID="e91dcdc187e0dd98c0cd2cd628141e75262fe1dc44182585b540f39789e453e8"
Sep 15 09:48:28.269824 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:28.269803    2575 scope.go:117] "RemoveContainer" containerID="5617401a7d1c2027474e604b96a6fafd9c07edb858ddb3a60ea2dc829c87d227"
Sep 15 09:48:28.270102 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:48:28.270082    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5617401a7d1c2027474e604b96a6fafd9c07edb858ddb3a60ea2dc829c87d227\": container with ID starting with 5617401a7d1c2027474e604b96a6fafd9c07edb858ddb3a60ea2dc829c87d227 not found: ID does not exist" containerID="5617401a7d1c2027474e604b96a6fafd9c07edb858ddb3a60ea2dc829c87d227"
Sep 15 09:48:28.270185 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:28.270113    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5617401a7d1c2027474e604b96a6fafd9c07edb858ddb3a60ea2dc829c87d227"} err="failed to get container status \"5617401a7d1c2027474e604b96a6fafd9c07edb858ddb3a60ea2dc829c87d227\": rpc error: code = NotFound desc = could not find container \"5617401a7d1c2027474e604b96a6fafd9c07edb858ddb3a60ea2dc829c87d227\": container with ID starting with 5617401a7d1c2027474e604b96a6fafd9c07edb858ddb3a60ea2dc829c87d227 not found: ID does not exist"
Sep 15 09:48:28.270185 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:28.270137    2575 scope.go:117] "RemoveContainer" containerID="e91dcdc187e0dd98c0cd2cd628141e75262fe1dc44182585b540f39789e453e8"
Sep 15 09:48:28.270416 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:48:28.270399    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e91dcdc187e0dd98c0cd2cd628141e75262fe1dc44182585b540f39789e453e8\": container with ID starting with e91dcdc187e0dd98c0cd2cd628141e75262fe1dc44182585b540f39789e453e8 not found: ID does not exist" containerID="e91dcdc187e0dd98c0cd2cd628141e75262fe1dc44182585b540f39789e453e8"
Sep 15 09:48:28.270460 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:28.270423    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e91dcdc187e0dd98c0cd2cd628141e75262fe1dc44182585b540f39789e453e8"} err="failed to get container status \"e91dcdc187e0dd98c0cd2cd628141e75262fe1dc44182585b540f39789e453e8\": rpc error: code = NotFound desc = could not find container \"e91dcdc187e0dd98c0cd2cd628141e75262fe1dc44182585b540f39789e453e8\": container with ID starting with e91dcdc187e0dd98c0cd2cd628141e75262fe1dc44182585b540f39789e453e8 not found: ID does not exist"
Sep 15 09:48:28.300539 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:28.300457    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"]
Sep 15 09:48:28.302520 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:28.302493    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-29a3ae-openshift-default-64d677d98-xnzp4"]
Sep 15 09:48:28.860540 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:28.860497    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65d1fe25-66ae-46fa-a683-3e3d58bb33b7" path="/var/lib/kubelet/pods/65d1fe25-66ae-46fa-a683-3e3d58bb33b7/volumes"
Sep 15 09:48:28.999514 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:28.999478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:29.404194 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:29.404167    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n"
Sep 15 09:48:29.581031 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:29.580954    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd167ac-c3c2-4b68-9c51-3fcad49f9abf-maas-api-service-ca\") pod \"5dd167ac-c3c2-4b68-9c51-3fcad49f9abf\" (UID: \"5dd167ac-c3c2-4b68-9c51-3fcad49f9abf\") "
Sep 15 09:48:29.581361 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:29.581341    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dd167ac-c3c2-4b68-9c51-3fcad49f9abf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5dd167ac-c3c2-4b68-9c51-3fcad49f9abf" (UID: "5dd167ac-c3c2-4b68-9c51-3fcad49f9abf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:48:29.682160 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:29.682124    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd167ac-c3c2-4b68-9c51-3fcad49f9abf-maas-api-service-ca\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:48:29.926018 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:29.925987    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:30.265836 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:30.265744    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n"
Sep 15 09:48:30.265836 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:30.265780    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n" event={"ID":"5dd167ac-c3c2-4b68-9c51-3fcad49f9abf","Type":"ContainerDied","Data":"4e9c5c8c556d962373d1d31ced7ecd221004685a78566d30bbea713e8bf3d4ee"}
Sep 15 09:48:30.265836 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:30.265830    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e9c5c8c556d962373d1d31ced7ecd221004685a78566d30bbea713e8bf3d4ee"
Sep 15 09:48:30.630502 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:30.630407    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:31.367093 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:31.367061    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:42.109713 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.109642    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:42.124887 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.124858    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"]
Sep 15 09:48:42.125159 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.125121    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g" podUID="6cb94919-d5e8-41e3-8d85-07a7dd69e1a4" containerName="payload-processing" containerID="cri-o://4dcd24f7b0058d1a839ee8fac2576bacb1aee6d161f9129427b8a009bdc3c995" gracePeriod=30
Sep 15 09:48:42.142008 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.141976    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"]
Sep 15 09:48:42.142245 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.142219    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq" podUID="bcb73465-99a8-4bc3-847a-24e502574598" containerName="payload-pre-processing" containerID="cri-o://bad9784aacbbf5e32d6d31758c31299c0fe691d0c6cf668d406699e48b407761" gracePeriod=30
Sep 15 09:48:42.212951 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.212920    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:42.315527 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.315405    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:42.344367 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.344331    2575 generic.go:356] "Generic (PLEG): container finished" podID="bcb73465-99a8-4bc3-847a-24e502574598" containerID="bad9784aacbbf5e32d6d31758c31299c0fe691d0c6cf668d406699e48b407761" exitCode=0
Sep 15 09:48:42.344586 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.344454    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq" event={"ID":"bcb73465-99a8-4bc3-847a-24e502574598","Type":"ContainerDied","Data":"bad9784aacbbf5e32d6d31758c31299c0fe691d0c6cf668d406699e48b407761"}
Sep 15 09:48:42.347161 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.347134    2575 generic.go:356] "Generic (PLEG): container finished" podID="6cb94919-d5e8-41e3-8d85-07a7dd69e1a4" containerID="4dcd24f7b0058d1a839ee8fac2576bacb1aee6d161f9129427b8a009bdc3c995" exitCode=0
Sep 15 09:48:42.347398 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.347209    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g" event={"ID":"6cb94919-d5e8-41e3-8d85-07a7dd69e1a4","Type":"ContainerDied","Data":"4dcd24f7b0058d1a839ee8fac2576bacb1aee6d161f9129427b8a009bdc3c995"}
Sep 15 09:48:42.361143 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.360853    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n"]
Sep 15 09:48:42.364016 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.363995    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6593fe-kzj9n"]
Sep 15 09:48:42.395622 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.395587    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:42.441701 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.441672    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"
Sep 15 09:48:42.446405 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.446380    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"
Sep 15 09:48:42.500108 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.500066    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcb73465-99a8-4bc3-847a-24e502574598-plugins-config-volume\") pod \"bcb73465-99a8-4bc3-847a-24e502574598\" (UID: \"bcb73465-99a8-4bc3-847a-24e502574598\") "
Sep 15 09:48:42.500310 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.500133    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cb94919-d5e8-41e3-8d85-07a7dd69e1a4-plugins-config-volume\") pod \"6cb94919-d5e8-41e3-8d85-07a7dd69e1a4\" (UID: \"6cb94919-d5e8-41e3-8d85-07a7dd69e1a4\") "
Sep 15 09:48:42.500310 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.500230    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xssbw\" (UniqueName: \"kubernetes.io/projected/6cb94919-d5e8-41e3-8d85-07a7dd69e1a4-kube-api-access-xssbw\") pod \"6cb94919-d5e8-41e3-8d85-07a7dd69e1a4\" (UID: \"6cb94919-d5e8-41e3-8d85-07a7dd69e1a4\") "
Sep 15 09:48:42.500310 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.500282    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd6cs\" (UniqueName: \"kubernetes.io/projected/bcb73465-99a8-4bc3-847a-24e502574598-kube-api-access-zd6cs\") pod \"bcb73465-99a8-4bc3-847a-24e502574598\" (UID: \"bcb73465-99a8-4bc3-847a-24e502574598\") "
Sep 15 09:48:42.500561 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.500516    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcb73465-99a8-4bc3-847a-24e502574598-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bcb73465-99a8-4bc3-847a-24e502574598" (UID: "bcb73465-99a8-4bc3-847a-24e502574598"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:48:42.500839 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.500814    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cb94919-d5e8-41e3-8d85-07a7dd69e1a4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6cb94919-d5e8-41e3-8d85-07a7dd69e1a4" (UID: "6cb94919-d5e8-41e3-8d85-07a7dd69e1a4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:48:42.501116 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.500872    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcb73465-99a8-4bc3-847a-24e502574598-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:48:42.502526 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.502501    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcb73465-99a8-4bc3-847a-24e502574598-kube-api-access-zd6cs" (OuterVolumeSpecName: "kube-api-access-zd6cs") pod "bcb73465-99a8-4bc3-847a-24e502574598" (UID: "bcb73465-99a8-4bc3-847a-24e502574598"). InnerVolumeSpecName "kube-api-access-zd6cs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:48:42.502849 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.502831    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cb94919-d5e8-41e3-8d85-07a7dd69e1a4-kube-api-access-xssbw" (OuterVolumeSpecName: "kube-api-access-xssbw") pod "6cb94919-d5e8-41e3-8d85-07a7dd69e1a4" (UID: "6cb94919-d5e8-41e3-8d85-07a7dd69e1a4"). InnerVolumeSpecName "kube-api-access-xssbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:48:42.602094 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.602062    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cb94919-d5e8-41e3-8d85-07a7dd69e1a4-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:48:42.602094 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.602091    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xssbw\" (UniqueName: \"kubernetes.io/projected/6cb94919-d5e8-41e3-8d85-07a7dd69e1a4-kube-api-access-xssbw\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:48:42.602094 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.602101    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd6cs\" (UniqueName: \"kubernetes.io/projected/bcb73465-99a8-4bc3-847a-24e502574598-kube-api-access-zd6cs\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:48:42.789341 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.789306    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:42.859974 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.859946    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dd167ac-c3c2-4b68-9c51-3fcad49f9abf" path="/var/lib/kubelet/pods/5dd167ac-c3c2-4b68-9c51-3fcad49f9abf/volumes"
Sep 15 09:48:42.883966 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:42.883940    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:43.354598 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:43.354566    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"
Sep 15 09:48:43.354598 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:43.354590    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq" event={"ID":"bcb73465-99a8-4bc3-847a-24e502574598","Type":"ContainerDied","Data":"26dd1b2c2fa067e9ec1b3cbd690f556d508443f04342ff5810ab3fa0a9f3b34d"}
Sep 15 09:48:43.355189 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:43.354648    2575 scope.go:117] "RemoveContainer" containerID="bad9784aacbbf5e32d6d31758c31299c0fe691d0c6cf668d406699e48b407761"
Sep 15 09:48:43.356091 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:43.356081    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"
Sep 15 09:48:43.356156 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:43.356126    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g" event={"ID":"6cb94919-d5e8-41e3-8d85-07a7dd69e1a4","Type":"ContainerDied","Data":"4634ed74717b01b11aadddf8d3b8b2b84d6ff78a4ffb059184e2d22847919790"}
Sep 15 09:48:43.364317 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:43.364299    2575 scope.go:117] "RemoveContainer" containerID="4dcd24f7b0058d1a839ee8fac2576bacb1aee6d161f9129427b8a009bdc3c995"
Sep 15 09:48:43.386565 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:43.386537    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"]
Sep 15 09:48:43.390706 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:43.390678    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6593fe-67994784db-slpzq"]
Sep 15 09:48:43.402266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:43.402210    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"]
Sep 15 09:48:43.406326 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:43.406298    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6593fe-7687b87789-n4k8g"]
Sep 15 09:48:43.668469 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:43.668381    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:44.477119 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:44.477066    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:44.858724 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:44.858643    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cb94919-d5e8-41e3-8d85-07a7dd69e1a4" path="/var/lib/kubelet/pods/6cb94919-d5e8-41e3-8d85-07a7dd69e1a4/volumes"
Sep 15 09:48:44.859044 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:44.859030    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcb73465-99a8-4bc3-847a-24e502574598" path="/var/lib/kubelet/pods/bcb73465-99a8-4bc3-847a-24e502574598/volumes"
Sep 15 09:48:45.593182 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:45.593130    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:47.775960 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:47.775903    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:48:56.999613 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:56.999587    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:48:57.002667 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:57.002645    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:48:57.005171 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:57.005151    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:48:57.008231 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:57.008215    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:48:57.261395 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:48:57.261318    2575 scope.go:117] "RemoveContainer" containerID="080a8a907d4f40c901f5f4b6060a89204805380391e2070c6f27bfc32f9fc8f3"
Sep 15 09:49:23.997639 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:23.997594    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:24.952160 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:24.952130    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:30.593075 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:30.593041    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:30.665136 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:30.665090    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:30.854323 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:30.854207    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:31.193196 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.193156    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6"]
Sep 15 09:49:31.193639 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.193620    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65d1fe25-66ae-46fa-a683-3e3d58bb33b7" containerName="istio-proxy"
Sep 15 09:49:31.193735 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.193642    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="65d1fe25-66ae-46fa-a683-3e3d58bb33b7" containerName="istio-proxy"
Sep 15 09:49:31.193735 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.193662    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dd167ac-c3c2-4b68-9c51-3fcad49f9abf" containerName="revoke-keys"
Sep 15 09:49:31.193735 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.193670    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dd167ac-c3c2-4b68-9c51-3fcad49f9abf" containerName="revoke-keys"
Sep 15 09:49:31.193735 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.193683    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cb94919-d5e8-41e3-8d85-07a7dd69e1a4" containerName="payload-processing"
Sep 15 09:49:31.193735 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.193692    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cb94919-d5e8-41e3-8d85-07a7dd69e1a4" containerName="payload-processing"
Sep 15 09:49:31.193735 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.193724    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcb73465-99a8-4bc3-847a-24e502574598" containerName="payload-pre-processing"
Sep 15 09:49:31.193735 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.193732    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcb73465-99a8-4bc3-847a-24e502574598" containerName="payload-pre-processing"
Sep 15 09:49:31.194117 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.193903    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="65d1fe25-66ae-46fa-a683-3e3d58bb33b7" containerName="istio-proxy"
Sep 15 09:49:31.194117 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.193922    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcb73465-99a8-4bc3-847a-24e502574598" containerName="payload-pre-processing"
Sep 15 09:49:31.194117 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.193934    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="65d1fe25-66ae-46fa-a683-3e3d58bb33b7" containerName="istio-proxy"
Sep 15 09:49:31.194117 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.193943    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dd167ac-c3c2-4b68-9c51-3fcad49f9abf" containerName="revoke-keys"
Sep 15 09:49:31.194117 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.193955    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cb94919-d5e8-41e3-8d85-07a7dd69e1a4" containerName="payload-processing"
Sep 15 09:49:31.197274 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.197253    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6"
Sep 15 09:49:31.199951 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.199933    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:49:31.204043 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.204021    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6"]
Sep 15 09:49:31.252869 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.252830    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d0ab0f5-30e9-443a-ba90-1ccce8f19526-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6\" (UID: \"7d0ab0f5-30e9-443a-ba90-1ccce8f19526\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6"
Sep 15 09:49:31.353845 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.353791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d0ab0f5-30e9-443a-ba90-1ccce8f19526-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6\" (UID: \"7d0ab0f5-30e9-443a-ba90-1ccce8f19526\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6"
Sep 15 09:49:31.354452 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.354419    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d0ab0f5-30e9-443a-ba90-1ccce8f19526-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6\" (UID: \"7d0ab0f5-30e9-443a-ba90-1ccce8f19526\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6"
Sep 15 09:49:31.510389 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.510306    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6"
Sep 15 09:49:31.783647 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:31.783625    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6"]
Sep 15 09:49:31.785433 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:49:31.785409    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d0ab0f5_30e9_443a_ba90_1ccce8f19526.slice/crio-5c88955d433f18acfe108999151f6d90cdefc37a43960ce26b82b3dd14ace890 WatchSource:0}: Error finding container 5c88955d433f18acfe108999151f6d90cdefc37a43960ce26b82b3dd14ace890: Status 404 returned error can't find the container with id 5c88955d433f18acfe108999151f6d90cdefc37a43960ce26b82b3dd14ace890
Sep 15 09:49:32.021562 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:32.021522    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:32.618031 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:32.617992    2575 generic.go:356] "Generic (PLEG): container finished" podID="7d0ab0f5-30e9-443a-ba90-1ccce8f19526" containerID="5948d67db07138a5c43ba495e692655cedd05f0d56815e12bf28096ff56d49a1" exitCode=0
Sep 15 09:49:32.618195 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:32.618030    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6" event={"ID":"7d0ab0f5-30e9-443a-ba90-1ccce8f19526","Type":"ContainerDied","Data":"5948d67db07138a5c43ba495e692655cedd05f0d56815e12bf28096ff56d49a1"}
Sep 15 09:49:32.618195 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:32.618085    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6" event={"ID":"7d0ab0f5-30e9-443a-ba90-1ccce8f19526","Type":"ContainerStarted","Data":"5c88955d433f18acfe108999151f6d90cdefc37a43960ce26b82b3dd14ace890"}
Sep 15 09:49:32.824954 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:32.824876    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:33.489857 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:33.489816    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:33.760169 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:33.760146    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6"
Sep 15 09:49:33.876318 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:33.876289    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d0ab0f5-30e9-443a-ba90-1ccce8f19526-maas-api-service-ca\") pod \"7d0ab0f5-30e9-443a-ba90-1ccce8f19526\" (UID: \"7d0ab0f5-30e9-443a-ba90-1ccce8f19526\") "
Sep 15 09:49:33.876696 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:33.876671    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d0ab0f5-30e9-443a-ba90-1ccce8f19526-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7d0ab0f5-30e9-443a-ba90-1ccce8f19526" (UID: "7d0ab0f5-30e9-443a-ba90-1ccce8f19526"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:49:33.977555 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:33.977520    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d0ab0f5-30e9-443a-ba90-1ccce8f19526-maas-api-service-ca\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:49:34.408646 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:34.408613    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:34.630175 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:34.630142    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6" event={"ID":"7d0ab0f5-30e9-443a-ba90-1ccce8f19526","Type":"ContainerDied","Data":"5c88955d433f18acfe108999151f6d90cdefc37a43960ce26b82b3dd14ace890"}
Sep 15 09:49:34.630175 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:34.630168    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6"
Sep 15 09:49:34.630385 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:34.630190    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c88955d433f18acfe108999151f6d90cdefc37a43960ce26b82b3dd14ace890"
Sep 15 09:49:41.806122 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:41.806092    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:41.874777 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:41.874729    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:41.943253 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:41.943215    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:42.014751 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:42.014707    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6"]
Sep 15 09:49:42.016266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:42.016239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:42.016863 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:42.016844    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-527142-k5hq6"]
Sep 15 09:49:42.089647 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:42.089552    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:42.433927 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:42.433890    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:42.542129 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:42.542096    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:42.859367 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:42.859293    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d0ab0f5-30e9-443a-ba90-1ccce8f19526" path="/var/lib/kubelet/pods/7d0ab0f5-30e9-443a-ba90-1ccce8f19526/volumes"
Sep 15 09:49:43.265820 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:43.265755    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:44.143085 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:44.143040    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:48.342226 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:48.342142    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:48.442433 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:48.442393    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:48.654568 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:48.654531    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"]
Sep 15 09:49:48.654834 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:48.654808    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq" podUID="70359691-c652-491e-8de0-7c71b3e58811" containerName="istio-proxy" containerID="cri-o://b77620affdb741a6f4563d3d8d5a20483ac486c8798bce48a5248055b725aed1" gracePeriod=30
Sep 15 09:49:48.664716 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:48.664690    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:48.985019 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:48.984935    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg"]
Sep 15 09:49:48.985576 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:48.985554    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65d1fe25-66ae-46fa-a683-3e3d58bb33b7" containerName="istio-proxy"
Sep 15 09:49:48.985620 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:48.985582    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="65d1fe25-66ae-46fa-a683-3e3d58bb33b7" containerName="istio-proxy"
Sep 15 09:49:48.985655 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:48.985627    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d0ab0f5-30e9-443a-ba90-1ccce8f19526" containerName="revoke-keys"
Sep 15 09:49:48.985655 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:48.985637    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d0ab0f5-30e9-443a-ba90-1ccce8f19526" containerName="revoke-keys"
Sep 15 09:49:48.985747 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:48.985735    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d0ab0f5-30e9-443a-ba90-1ccce8f19526" containerName="revoke-keys"
Sep 15 09:49:48.989070 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:48.989055    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg"
Sep 15 09:49:48.991511 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:48.991490    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:49:48.994656 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:48.994631    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg"]
Sep 15 09:49:49.119076 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:49.119042    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99f90804-00a1-4a56-9003-8090e29cb221-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg\" (UID: \"99f90804-00a1-4a56-9003-8090e29cb221\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg"
Sep 15 09:49:49.154282 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:49.154242    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:49.220601 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:49.220566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99f90804-00a1-4a56-9003-8090e29cb221-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg\" (UID: \"99f90804-00a1-4a56-9003-8090e29cb221\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg"
Sep 15 09:49:49.221253 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:49.221235    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99f90804-00a1-4a56-9003-8090e29cb221-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg\" (UID: \"99f90804-00a1-4a56-9003-8090e29cb221\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg"
Sep 15 09:49:49.302413 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:49.302334    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg"
Sep 15 09:49:49.582002 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:49.581978    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg"]
Sep 15 09:49:49.584260 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:49:49.584227    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99f90804_00a1_4a56_9003_8090e29cb221.slice/crio-09fd90ac22d66eb870ac071df7472ca518a564c4b11b9fe5a7e520cd4542eabd WatchSource:0}: Error finding container 09fd90ac22d66eb870ac071df7472ca518a564c4b11b9fe5a7e520cd4542eabd: Status 404 returned error can't find the container with id 09fd90ac22d66eb870ac071df7472ca518a564c4b11b9fe5a7e520cd4542eabd
Sep 15 09:49:49.710655 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:49.710618    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg" event={"ID":"99f90804-00a1-4a56-9003-8090e29cb221","Type":"ContainerStarted","Data":"09fd90ac22d66eb870ac071df7472ca518a564c4b11b9fe5a7e520cd4542eabd"}
Sep 15 09:49:50.039882 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:50.039856    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:50.655375 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:50.655331    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 09:49:50.655785 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:50.655402    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq" podUID="70359691-c652-491e-8de0-7c71b3e58811" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 09:49:50.718907 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:50.718877    2575 generic.go:356] "Generic (PLEG): container finished" podID="99f90804-00a1-4a56-9003-8090e29cb221" containerID="33a6c0a4f8469a5b96ac3545541ed616afce7931981bed23e3d9262acfc80cef" exitCode=0
Sep 15 09:49:50.719073 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:50.718961    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg" event={"ID":"99f90804-00a1-4a56-9003-8090e29cb221","Type":"ContainerDied","Data":"33a6c0a4f8469a5b96ac3545541ed616afce7931981bed23e3d9262acfc80cef"}
Sep 15 09:49:50.834433 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:50.834391    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:51.562656 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:51.562627    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:51.860204 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:51.860181    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg"
Sep 15 09:49:51.944846 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:51.944817    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99f90804-00a1-4a56-9003-8090e29cb221-maas-api-service-ca\") pod \"99f90804-00a1-4a56-9003-8090e29cb221\" (UID: \"99f90804-00a1-4a56-9003-8090e29cb221\") "
Sep 15 09:49:51.945209 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:51.945184    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99f90804-00a1-4a56-9003-8090e29cb221-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "99f90804-00a1-4a56-9003-8090e29cb221" (UID: "99f90804-00a1-4a56-9003-8090e29cb221"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:49:52.046013 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:52.045983    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99f90804-00a1-4a56-9003-8090e29cb221-maas-api-service-ca\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:49:52.730729 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:52.730695    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg" event={"ID":"99f90804-00a1-4a56-9003-8090e29cb221","Type":"ContainerDied","Data":"09fd90ac22d66eb870ac071df7472ca518a564c4b11b9fe5a7e520cd4542eabd"}
Sep 15 09:49:52.730920 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:52.730702    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg"
Sep 15 09:49:52.730920 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:52.730792    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09fd90ac22d66eb870ac071df7472ca518a564c4b11b9fe5a7e520cd4542eabd"
Sep 15 09:49:53.912601 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:53.912578    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:49:54.062026 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.061942    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70359691-c652-491e-8de0-7c71b3e58811-istio-podinfo\") pod \"70359691-c652-491e-8de0-7c71b3e58811\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") "
Sep 15 09:49:54.062026 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.061986    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-credential-socket\") pod \"70359691-c652-491e-8de0-7c71b3e58811\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") "
Sep 15 09:49:54.062026 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.062009    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-istio-envoy\") pod \"70359691-c652-491e-8de0-7c71b3e58811\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") "
Sep 15 09:49:54.062330 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.062030    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70359691-c652-491e-8de0-7c71b3e58811-istiod-ca-cert\") pod \"70359691-c652-491e-8de0-7c71b3e58811\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") "
Sep 15 09:49:54.062330 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.062161    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-workload-socket\") pod \"70359691-c652-491e-8de0-7c71b3e58811\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") "
Sep 15 09:49:54.062330 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.062207    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70359691-c652-491e-8de0-7c71b3e58811-istio-token\") pod \"70359691-c652-491e-8de0-7c71b3e58811\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") "
Sep 15 09:49:54.062330 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.062269    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-workload-certs\") pod \"70359691-c652-491e-8de0-7c71b3e58811\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") "
Sep 15 09:49:54.062330 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.062291    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "70359691-c652-491e-8de0-7c71b3e58811" (UID: "70359691-c652-491e-8de0-7c71b3e58811"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:49:54.062330 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.062309    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-istio-data\") pod \"70359691-c652-491e-8de0-7c71b3e58811\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") "
Sep 15 09:49:54.062653 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.062365    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l54v\" (UniqueName: \"kubernetes.io/projected/70359691-c652-491e-8de0-7c71b3e58811-kube-api-access-5l54v\") pod \"70359691-c652-491e-8de0-7c71b3e58811\" (UID: \"70359691-c652-491e-8de0-7c71b3e58811\") "
Sep 15 09:49:54.062653 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.062403    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "70359691-c652-491e-8de0-7c71b3e58811" (UID: "70359691-c652-491e-8de0-7c71b3e58811"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:49:54.062653 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.062446    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70359691-c652-491e-8de0-7c71b3e58811-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "70359691-c652-491e-8de0-7c71b3e58811" (UID: "70359691-c652-491e-8de0-7c71b3e58811"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:49:54.062653 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.062515    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "70359691-c652-491e-8de0-7c71b3e58811" (UID: "70359691-c652-491e-8de0-7c71b3e58811"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:49:54.062653 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.062644    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-istio-data" (OuterVolumeSpecName: "istio-data") pod "70359691-c652-491e-8de0-7c71b3e58811" (UID: "70359691-c652-491e-8de0-7c71b3e58811"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:49:54.062974 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.062710    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-workload-certs\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:49:54.062974 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.062815    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-credential-socket\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:49:54.062974 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.062929    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70359691-c652-491e-8de0-7c71b3e58811-istiod-ca-cert\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:49:54.062974 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.062952    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-workload-socket\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:49:54.064447 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.064423    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "70359691-c652-491e-8de0-7c71b3e58811" (UID: "70359691-c652-491e-8de0-7c71b3e58811"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:49:54.064447 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.064434    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70359691-c652-491e-8de0-7c71b3e58811-istio-token" (OuterVolumeSpecName: "istio-token") pod "70359691-c652-491e-8de0-7c71b3e58811" (UID: "70359691-c652-491e-8de0-7c71b3e58811"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:49:54.064615 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.064490    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70359691-c652-491e-8de0-7c71b3e58811-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "70359691-c652-491e-8de0-7c71b3e58811" (UID: "70359691-c652-491e-8de0-7c71b3e58811"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:49:54.064615 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.064605    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70359691-c652-491e-8de0-7c71b3e58811-kube-api-access-5l54v" (OuterVolumeSpecName: "kube-api-access-5l54v") pod "70359691-c652-491e-8de0-7c71b3e58811" (UID: "70359691-c652-491e-8de0-7c71b3e58811"). InnerVolumeSpecName "kube-api-access-5l54v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:49:54.163856 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.163829    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70359691-c652-491e-8de0-7c71b3e58811-istio-token\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:49:54.163856 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.163851    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-istio-data\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:49:54.163856 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.163861    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l54v\" (UniqueName: \"kubernetes.io/projected/70359691-c652-491e-8de0-7c71b3e58811-kube-api-access-5l54v\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:49:54.164068 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.163870    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70359691-c652-491e-8de0-7c71b3e58811-istio-podinfo\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:49:54.164068 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.163879    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70359691-c652-491e-8de0-7c71b3e58811-istio-envoy\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:49:54.742916 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.742881    2575 generic.go:356] "Generic (PLEG): container finished" podID="70359691-c652-491e-8de0-7c71b3e58811" containerID="b77620affdb741a6f4563d3d8d5a20483ac486c8798bce48a5248055b725aed1" exitCode=0
Sep 15 09:49:54.743099 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.742937    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"
Sep 15 09:49:54.743099 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.742961    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq" event={"ID":"70359691-c652-491e-8de0-7c71b3e58811","Type":"ContainerDied","Data":"b77620affdb741a6f4563d3d8d5a20483ac486c8798bce48a5248055b725aed1"}
Sep 15 09:49:54.743099 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.743018    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq" event={"ID":"70359691-c652-491e-8de0-7c71b3e58811","Type":"ContainerDied","Data":"343f808af27dfbba9b402e36df040d1a37b512cbb2aae96d22c648479d9faf0a"}
Sep 15 09:49:54.743099 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.743045    2575 scope.go:117] "RemoveContainer" containerID="b77620affdb741a6f4563d3d8d5a20483ac486c8798bce48a5248055b725aed1"
Sep 15 09:49:54.753016 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.752995    2575 scope.go:117] "RemoveContainer" containerID="3a8f236acfec7226a02def8a58edfb208305c766f7003cf2d0674655e304f407"
Sep 15 09:49:54.761041 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.761019    2575 scope.go:117] "RemoveContainer" containerID="b77620affdb741a6f4563d3d8d5a20483ac486c8798bce48a5248055b725aed1"
Sep 15 09:49:54.761315 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:49:54.761293    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b77620affdb741a6f4563d3d8d5a20483ac486c8798bce48a5248055b725aed1\": container with ID starting with b77620affdb741a6f4563d3d8d5a20483ac486c8798bce48a5248055b725aed1 not found: ID does not exist" containerID="b77620affdb741a6f4563d3d8d5a20483ac486c8798bce48a5248055b725aed1"
Sep 15 09:49:54.761413 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.761320    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b77620affdb741a6f4563d3d8d5a20483ac486c8798bce48a5248055b725aed1"} err="failed to get container status \"b77620affdb741a6f4563d3d8d5a20483ac486c8798bce48a5248055b725aed1\": rpc error: code = NotFound desc = could not find container \"b77620affdb741a6f4563d3d8d5a20483ac486c8798bce48a5248055b725aed1\": container with ID starting with b77620affdb741a6f4563d3d8d5a20483ac486c8798bce48a5248055b725aed1 not found: ID does not exist"
Sep 15 09:49:54.761413 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.761336    2575 scope.go:117] "RemoveContainer" containerID="3a8f236acfec7226a02def8a58edfb208305c766f7003cf2d0674655e304f407"
Sep 15 09:49:54.761556 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:49:54.761539    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a8f236acfec7226a02def8a58edfb208305c766f7003cf2d0674655e304f407\": container with ID starting with 3a8f236acfec7226a02def8a58edfb208305c766f7003cf2d0674655e304f407 not found: ID does not exist" containerID="3a8f236acfec7226a02def8a58edfb208305c766f7003cf2d0674655e304f407"
Sep 15 09:49:54.761604 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.761561    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a8f236acfec7226a02def8a58edfb208305c766f7003cf2d0674655e304f407"} err="failed to get container status \"3a8f236acfec7226a02def8a58edfb208305c766f7003cf2d0674655e304f407\": rpc error: code = NotFound desc = could not find container \"3a8f236acfec7226a02def8a58edfb208305c766f7003cf2d0674655e304f407\": container with ID starting with 3a8f236acfec7226a02def8a58edfb208305c766f7003cf2d0674655e304f407 not found: ID does not exist"
Sep 15 09:49:54.764907 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.764887    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"]
Sep 15 09:49:54.769387 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.769368    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-527142-openshift-default-665f987454-6r4fq"]
Sep 15 09:49:54.859886 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:54.859859    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70359691-c652-491e-8de0-7c71b3e58811" path="/var/lib/kubelet/pods/70359691-c652-491e-8de0-7c71b3e58811/volumes"
Sep 15 09:49:59.595840 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:59.595801    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:59.601220 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:59.601191    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-864b9a-29824425-5xg28"]
Sep 15 09:49:59.604341 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:59.604321    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-864b9a-29824425-5xg28"]
Sep 15 09:49:59.659023 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:59.658980    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"]
Sep 15 09:49:59.659257 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:59.659233    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k" podUID="5d2effad-1aa6-4a83-a1bd-807cfe037e32" containerName="payload-pre-processing" containerID="cri-o://9b5fee30536ec4d2d01dbf428f232e594ef1cb9406d1017c0fa504ffdf1ee47e" gracePeriod=30
Sep 15 09:49:59.699090 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:59.699063    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:59.805019 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:59.804978    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:59.890645 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:59.890548    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg"]
Sep 15 09:49:59.894264 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:59.894233    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-864b9a-vm4hg"]
Sep 15 09:49:59.899239 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:59.899210    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:49:59.924114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:59.924088    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"
Sep 15 09:49:59.984859 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:49:59.984800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:00.021155 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.021121    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d2effad-1aa6-4a83-a1bd-807cfe037e32-plugins-config-volume\") pod \"5d2effad-1aa6-4a83-a1bd-807cfe037e32\" (UID: \"5d2effad-1aa6-4a83-a1bd-807cfe037e32\") "
Sep 15 09:50:00.021321 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.021205    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phcgs\" (UniqueName: \"kubernetes.io/projected/5d2effad-1aa6-4a83-a1bd-807cfe037e32-kube-api-access-phcgs\") pod \"5d2effad-1aa6-4a83-a1bd-807cfe037e32\" (UID: \"5d2effad-1aa6-4a83-a1bd-807cfe037e32\") "
Sep 15 09:50:00.021517 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.021496    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d2effad-1aa6-4a83-a1bd-807cfe037e32-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5d2effad-1aa6-4a83-a1bd-807cfe037e32" (UID: "5d2effad-1aa6-4a83-a1bd-807cfe037e32"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:50:00.021602 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.021581    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d2effad-1aa6-4a83-a1bd-807cfe037e32-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:00.023466 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.023434    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d2effad-1aa6-4a83-a1bd-807cfe037e32-kube-api-access-phcgs" (OuterVolumeSpecName: "kube-api-access-phcgs") pod "5d2effad-1aa6-4a83-a1bd-807cfe037e32" (UID: "5d2effad-1aa6-4a83-a1bd-807cfe037e32"). InnerVolumeSpecName "kube-api-access-phcgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:50:00.122786 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.122732    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phcgs\" (UniqueName: \"kubernetes.io/projected/5d2effad-1aa6-4a83-a1bd-807cfe037e32-kube-api-access-phcgs\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:00.718240 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.718207    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:00.777070 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.777030    2575 generic.go:356] "Generic (PLEG): container finished" podID="5d2effad-1aa6-4a83-a1bd-807cfe037e32" containerID="9b5fee30536ec4d2d01dbf428f232e594ef1cb9406d1017c0fa504ffdf1ee47e" exitCode=0
Sep 15 09:50:00.777070 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.777071    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"
Sep 15 09:50:00.777331 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.777107    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k" event={"ID":"5d2effad-1aa6-4a83-a1bd-807cfe037e32","Type":"ContainerDied","Data":"9b5fee30536ec4d2d01dbf428f232e594ef1cb9406d1017c0fa504ffdf1ee47e"}
Sep 15 09:50:00.777331 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.777163    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k" event={"ID":"5d2effad-1aa6-4a83-a1bd-807cfe037e32","Type":"ContainerDied","Data":"6c39cabb737eb36331bc511a1bf6612409c36df382453bc745033ba6d4e15dd3"}
Sep 15 09:50:00.777331 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.777192    2575 scope.go:117] "RemoveContainer" containerID="9b5fee30536ec4d2d01dbf428f232e594ef1cb9406d1017c0fa504ffdf1ee47e"
Sep 15 09:50:00.787649 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.787629    2575 scope.go:117] "RemoveContainer" containerID="9b5fee30536ec4d2d01dbf428f232e594ef1cb9406d1017c0fa504ffdf1ee47e"
Sep 15 09:50:00.787978 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:50:00.787955    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b5fee30536ec4d2d01dbf428f232e594ef1cb9406d1017c0fa504ffdf1ee47e\": container with ID starting with 9b5fee30536ec4d2d01dbf428f232e594ef1cb9406d1017c0fa504ffdf1ee47e not found: ID does not exist" containerID="9b5fee30536ec4d2d01dbf428f232e594ef1cb9406d1017c0fa504ffdf1ee47e"
Sep 15 09:50:00.788067 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.787990    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b5fee30536ec4d2d01dbf428f232e594ef1cb9406d1017c0fa504ffdf1ee47e"} err="failed to get container status \"9b5fee30536ec4d2d01dbf428f232e594ef1cb9406d1017c0fa504ffdf1ee47e\": rpc error: code = NotFound desc = could not find container \"9b5fee30536ec4d2d01dbf428f232e594ef1cb9406d1017c0fa504ffdf1ee47e\": container with ID starting with 9b5fee30536ec4d2d01dbf428f232e594ef1cb9406d1017c0fa504ffdf1ee47e not found: ID does not exist"
Sep 15 09:50:00.801704 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.801677    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"]
Sep 15 09:50:00.806155 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.806130    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-864b9a-dbdb9b5db-x292k"]
Sep 15 09:50:00.807321 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.807298    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:00.858884 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.858855    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d2effad-1aa6-4a83-a1bd-807cfe037e32" path="/var/lib/kubelet/pods/5d2effad-1aa6-4a83-a1bd-807cfe037e32/volumes"
Sep 15 09:50:00.859204 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.859190    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e1f29ca-f139-4df4-b93a-e567b0d26977" path="/var/lib/kubelet/pods/5e1f29ca-f139-4df4-b93a-e567b0d26977/volumes"
Sep 15 09:50:00.859446 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:00.859434    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99f90804-00a1-4a56-9003-8090e29cb221" path="/var/lib/kubelet/pods/99f90804-00a1-4a56-9003-8090e29cb221/volumes"
Sep 15 09:50:01.583453 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:01.583395    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:06.250121 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:06.250091    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:06.347954 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:06.347924    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:06.507513 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:06.507432    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"]
Sep 15 09:50:06.507683 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:06.507662    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm" podUID="5c767bdb-daea-45af-b9d9-8a2dbbe254bd" containerName="istio-proxy" containerID="cri-o://45f0c06649617e7abd2ed4175fa712b0456d43ba4abacce9189ec6b7ef35f45b" gracePeriod=30
Sep 15 09:50:06.565865 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:06.565832    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:07.150155 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:07.150118    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:08.331957 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:08.331908    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:08.639721 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:08.639689    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:09.083322 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:09.083231    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 09:50:09.083471 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:09.083317    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm" podUID="5c767bdb-daea-45af-b9d9-8a2dbbe254bd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 09:50:11.765216 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.765194    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:50:11.823951 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.823874    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-podinfo\") pod \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") "
Sep 15 09:50:11.823951 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.823928    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-data\") pod \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") "
Sep 15 09:50:11.824170 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.823977    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzvff\" (UniqueName: \"kubernetes.io/projected/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-kube-api-access-tzvff\") pod \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") "
Sep 15 09:50:11.824170 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.823995    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-credential-socket\") pod \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") "
Sep 15 09:50:11.824170 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.824013    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-token\") pod \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") "
Sep 15 09:50:11.824170 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.824043    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-envoy\") pod \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") "
Sep 15 09:50:11.824170 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.824090    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-workload-socket\") pod \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") "
Sep 15 09:50:11.824170 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.824135    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-workload-certs\") pod \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") "
Sep 15 09:50:11.824170 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.824163    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istiod-ca-cert\") pod \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\" (UID: \"5c767bdb-daea-45af-b9d9-8a2dbbe254bd\") "
Sep 15 09:50:11.824535 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.824302    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-data" (OuterVolumeSpecName: "istio-data") pod "5c767bdb-daea-45af-b9d9-8a2dbbe254bd" (UID: "5c767bdb-daea-45af-b9d9-8a2dbbe254bd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:50:11.824535 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.824480    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5c767bdb-daea-45af-b9d9-8a2dbbe254bd" (UID: "5c767bdb-daea-45af-b9d9-8a2dbbe254bd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:50:11.824535 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.824514    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5c767bdb-daea-45af-b9d9-8a2dbbe254bd" (UID: "5c767bdb-daea-45af-b9d9-8a2dbbe254bd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:50:11.825326 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.824645    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5c767bdb-daea-45af-b9d9-8a2dbbe254bd" (UID: "5c767bdb-daea-45af-b9d9-8a2dbbe254bd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:50:11.825326 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.824691    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5c767bdb-daea-45af-b9d9-8a2dbbe254bd" (UID: "5c767bdb-daea-45af-b9d9-8a2dbbe254bd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:50:11.825326 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.824993    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-data\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:11.825326 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.825013    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-credential-socket\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:11.825326 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.825027    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-workload-socket\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:11.825326 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.825041    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-workload-certs\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:11.825326 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.825053    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istiod-ca-cert\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:11.826456 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.826436    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-kube-api-access-tzvff" (OuterVolumeSpecName: "kube-api-access-tzvff") pod "5c767bdb-daea-45af-b9d9-8a2dbbe254bd" (UID: "5c767bdb-daea-45af-b9d9-8a2dbbe254bd"). InnerVolumeSpecName "kube-api-access-tzvff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:50:11.826551 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.826458    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5c767bdb-daea-45af-b9d9-8a2dbbe254bd" (UID: "5c767bdb-daea-45af-b9d9-8a2dbbe254bd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:50:11.826732 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.826711    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5c767bdb-daea-45af-b9d9-8a2dbbe254bd" (UID: "5c767bdb-daea-45af-b9d9-8a2dbbe254bd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:50:11.826820 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.826752    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-token" (OuterVolumeSpecName: "istio-token") pod "5c767bdb-daea-45af-b9d9-8a2dbbe254bd" (UID: "5c767bdb-daea-45af-b9d9-8a2dbbe254bd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:50:11.838548 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.838522    2575 generic.go:356] "Generic (PLEG): container finished" podID="5c767bdb-daea-45af-b9d9-8a2dbbe254bd" containerID="45f0c06649617e7abd2ed4175fa712b0456d43ba4abacce9189ec6b7ef35f45b" exitCode=0
Sep 15 09:50:11.838671 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.838582    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"
Sep 15 09:50:11.838671 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.838587    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm" event={"ID":"5c767bdb-daea-45af-b9d9-8a2dbbe254bd","Type":"ContainerDied","Data":"45f0c06649617e7abd2ed4175fa712b0456d43ba4abacce9189ec6b7ef35f45b"}
Sep 15 09:50:11.838805 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.838699    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm" event={"ID":"5c767bdb-daea-45af-b9d9-8a2dbbe254bd","Type":"ContainerDied","Data":"6741c705b27b0f743b9bdc150ae445fbe96a33a1d08d7964dac1c7235b2434b3"}
Sep 15 09:50:11.838805 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.838722    2575 scope.go:117] "RemoveContainer" containerID="45f0c06649617e7abd2ed4175fa712b0456d43ba4abacce9189ec6b7ef35f45b"
Sep 15 09:50:11.850867 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.850741    2575 scope.go:117] "RemoveContainer" containerID="6a2031250b28e9b75ea9d49a0f5bc571bc742e8c924cf36ca1178e232a04b99d"
Sep 15 09:50:11.860505 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.860486    2575 scope.go:117] "RemoveContainer" containerID="45f0c06649617e7abd2ed4175fa712b0456d43ba4abacce9189ec6b7ef35f45b"
Sep 15 09:50:11.860867 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.860850    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"]
Sep 15 09:50:11.860934 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:50:11.860842    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45f0c06649617e7abd2ed4175fa712b0456d43ba4abacce9189ec6b7ef35f45b\": container with ID starting with 45f0c06649617e7abd2ed4175fa712b0456d43ba4abacce9189ec6b7ef35f45b not found: ID does not exist" containerID="45f0c06649617e7abd2ed4175fa712b0456d43ba4abacce9189ec6b7ef35f45b"
Sep 15 09:50:11.860934 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.860902    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45f0c06649617e7abd2ed4175fa712b0456d43ba4abacce9189ec6b7ef35f45b"} err="failed to get container status \"45f0c06649617e7abd2ed4175fa712b0456d43ba4abacce9189ec6b7ef35f45b\": rpc error: code = NotFound desc = could not find container \"45f0c06649617e7abd2ed4175fa712b0456d43ba4abacce9189ec6b7ef35f45b\": container with ID starting with 45f0c06649617e7abd2ed4175fa712b0456d43ba4abacce9189ec6b7ef35f45b not found: ID does not exist"
Sep 15 09:50:11.860934 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.860919    2575 scope.go:117] "RemoveContainer" containerID="6a2031250b28e9b75ea9d49a0f5bc571bc742e8c924cf36ca1178e232a04b99d"
Sep 15 09:50:11.861236 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:50:11.861210    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a2031250b28e9b75ea9d49a0f5bc571bc742e8c924cf36ca1178e232a04b99d\": container with ID starting with 6a2031250b28e9b75ea9d49a0f5bc571bc742e8c924cf36ca1178e232a04b99d not found: ID does not exist" containerID="6a2031250b28e9b75ea9d49a0f5bc571bc742e8c924cf36ca1178e232a04b99d"
Sep 15 09:50:11.861281 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.861242    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a2031250b28e9b75ea9d49a0f5bc571bc742e8c924cf36ca1178e232a04b99d"} err="failed to get container status \"6a2031250b28e9b75ea9d49a0f5bc571bc742e8c924cf36ca1178e232a04b99d\": rpc error: code = NotFound desc = could not find container \"6a2031250b28e9b75ea9d49a0f5bc571bc742e8c924cf36ca1178e232a04b99d\": container with ID starting with 6a2031250b28e9b75ea9d49a0f5bc571bc742e8c924cf36ca1178e232a04b99d not found: ID does not exist"
Sep 15 09:50:11.865016 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.864992    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-864b9a-openshift-default-75b5b486bd-g87lm"]
Sep 15 09:50:11.926317 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.926283    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzvff\" (UniqueName: \"kubernetes.io/projected/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-kube-api-access-tzvff\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:11.926317 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.926310    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-token\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:11.926317 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.926320    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-envoy\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:11.926491 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:11.926329    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c767bdb-daea-45af-b9d9-8a2dbbe254bd-istio-podinfo\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:12.858281 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:12.858249    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c767bdb-daea-45af-b9d9-8a2dbbe254bd" path="/var/lib/kubelet/pods/5c767bdb-daea-45af-b9d9-8a2dbbe254bd/volumes"
Sep 15 09:50:17.556421 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.556382    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b283ee-29824425-fpkfm"]
Sep 15 09:50:17.561704 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.561678    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b283ee-29824425-fpkfm"]
Sep 15 09:50:17.562285 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.562250    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:17.604974 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.604940    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"]
Sep 15 09:50:17.605188 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.605150    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74" podUID="1c092ea1-31da-4fb5-952d-22acfabfd4a8" containerName="payload-processing" containerID="cri-o://715167f0b07f5a5b089533639f162fe53b3da04c783212efce8656decf39aa51" gracePeriod=30
Sep 15 09:50:17.609302 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.609275    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"]
Sep 15 09:50:17.609507 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.609477    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb" podUID="690ea2d0-3693-4749-b62e-6230967a3b1d" containerName="payload-pre-processing" containerID="cri-o://fef685795ba636b69e90cd0595312ef7aabf3a2c487434fd53706c81cff82572" gracePeriod=30
Sep 15 09:50:17.657089 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.657040    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:17.757064 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.757023    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:17.857180 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.857149    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:17.866665 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.866641    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"
Sep 15 09:50:17.871229 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.871198    2575 generic.go:356] "Generic (PLEG): container finished" podID="690ea2d0-3693-4749-b62e-6230967a3b1d" containerID="fef685795ba636b69e90cd0595312ef7aabf3a2c487434fd53706c81cff82572" exitCode=0
Sep 15 09:50:17.871372 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.871301    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"
Sep 15 09:50:17.871372 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.871339    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb" event={"ID":"690ea2d0-3693-4749-b62e-6230967a3b1d","Type":"ContainerDied","Data":"fef685795ba636b69e90cd0595312ef7aabf3a2c487434fd53706c81cff82572"}
Sep 15 09:50:17.871485 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.871392    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb" event={"ID":"690ea2d0-3693-4749-b62e-6230967a3b1d","Type":"ContainerDied","Data":"3ac09e5759bcdf8b9f7a2022c8493217e5b335875cd35283256af31970a8748f"}
Sep 15 09:50:17.871485 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.871420    2575 scope.go:117] "RemoveContainer" containerID="fef685795ba636b69e90cd0595312ef7aabf3a2c487434fd53706c81cff82572"
Sep 15 09:50:17.873307 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.873280    2575 generic.go:356] "Generic (PLEG): container finished" podID="1c092ea1-31da-4fb5-952d-22acfabfd4a8" containerID="715167f0b07f5a5b089533639f162fe53b3da04c783212efce8656decf39aa51" exitCode=0
Sep 15 09:50:17.873429 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.873334    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74" event={"ID":"1c092ea1-31da-4fb5-952d-22acfabfd4a8","Type":"ContainerDied","Data":"715167f0b07f5a5b089533639f162fe53b3da04c783212efce8656decf39aa51"}
Sep 15 09:50:17.880834 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.880813    2575 scope.go:117] "RemoveContainer" containerID="fef685795ba636b69e90cd0595312ef7aabf3a2c487434fd53706c81cff82572"
Sep 15 09:50:17.881189 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:50:17.881165    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fef685795ba636b69e90cd0595312ef7aabf3a2c487434fd53706c81cff82572\": container with ID starting with fef685795ba636b69e90cd0595312ef7aabf3a2c487434fd53706c81cff82572 not found: ID does not exist" containerID="fef685795ba636b69e90cd0595312ef7aabf3a2c487434fd53706c81cff82572"
Sep 15 09:50:17.881269 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.881198    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fef685795ba636b69e90cd0595312ef7aabf3a2c487434fd53706c81cff82572"} err="failed to get container status \"fef685795ba636b69e90cd0595312ef7aabf3a2c487434fd53706c81cff82572\": rpc error: code = NotFound desc = could not find container \"fef685795ba636b69e90cd0595312ef7aabf3a2c487434fd53706c81cff82572\": container with ID starting with fef685795ba636b69e90cd0595312ef7aabf3a2c487434fd53706c81cff82572 not found: ID does not exist"
Sep 15 09:50:17.903994 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.903973    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"
Sep 15 09:50:17.975267 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.975239    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c092ea1-31da-4fb5-952d-22acfabfd4a8-plugins-config-volume\") pod \"1c092ea1-31da-4fb5-952d-22acfabfd4a8\" (UID: \"1c092ea1-31da-4fb5-952d-22acfabfd4a8\") "
Sep 15 09:50:17.975446 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.975278    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7wz2\" (UniqueName: \"kubernetes.io/projected/1c092ea1-31da-4fb5-952d-22acfabfd4a8-kube-api-access-h7wz2\") pod \"1c092ea1-31da-4fb5-952d-22acfabfd4a8\" (UID: \"1c092ea1-31da-4fb5-952d-22acfabfd4a8\") "
Sep 15 09:50:17.975446 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.975296    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/690ea2d0-3693-4749-b62e-6230967a3b1d-plugins-config-volume\") pod \"690ea2d0-3693-4749-b62e-6230967a3b1d\" (UID: \"690ea2d0-3693-4749-b62e-6230967a3b1d\") "
Sep 15 09:50:17.975446 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.975323    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6njjb\" (UniqueName: \"kubernetes.io/projected/690ea2d0-3693-4749-b62e-6230967a3b1d-kube-api-access-6njjb\") pod \"690ea2d0-3693-4749-b62e-6230967a3b1d\" (UID: \"690ea2d0-3693-4749-b62e-6230967a3b1d\") "
Sep 15 09:50:17.975667 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.975637    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c092ea1-31da-4fb5-952d-22acfabfd4a8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1c092ea1-31da-4fb5-952d-22acfabfd4a8" (UID: "1c092ea1-31da-4fb5-952d-22acfabfd4a8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:50:17.975821 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.975639    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/690ea2d0-3693-4749-b62e-6230967a3b1d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "690ea2d0-3693-4749-b62e-6230967a3b1d" (UID: "690ea2d0-3693-4749-b62e-6230967a3b1d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:50:17.977472 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.977454    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c092ea1-31da-4fb5-952d-22acfabfd4a8-kube-api-access-h7wz2" (OuterVolumeSpecName: "kube-api-access-h7wz2") pod "1c092ea1-31da-4fb5-952d-22acfabfd4a8" (UID: "1c092ea1-31da-4fb5-952d-22acfabfd4a8"). InnerVolumeSpecName "kube-api-access-h7wz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:50:17.977550 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:17.977504    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/690ea2d0-3693-4749-b62e-6230967a3b1d-kube-api-access-6njjb" (OuterVolumeSpecName: "kube-api-access-6njjb") pod "690ea2d0-3693-4749-b62e-6230967a3b1d" (UID: "690ea2d0-3693-4749-b62e-6230967a3b1d"). InnerVolumeSpecName "kube-api-access-6njjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:50:18.076311 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:18.076226    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6njjb\" (UniqueName: \"kubernetes.io/projected/690ea2d0-3693-4749-b62e-6230967a3b1d-kube-api-access-6njjb\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:18.076311 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:18.076254    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c092ea1-31da-4fb5-952d-22acfabfd4a8-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:18.076311 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:18.076263    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7wz2\" (UniqueName: \"kubernetes.io/projected/1c092ea1-31da-4fb5-952d-22acfabfd4a8-kube-api-access-h7wz2\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:18.076311 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:18.076272    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/690ea2d0-3693-4749-b62e-6230967a3b1d-plugins-config-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:18.187686 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:18.187661    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:18.194177 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:18.194148    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"]
Sep 15 09:50:18.199287 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:18.199264    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b283ee-55bbb87598-zgdxb"]
Sep 15 09:50:18.290256 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:18.290208    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:18.858971 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:18.858941    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="690ea2d0-3693-4749-b62e-6230967a3b1d" path="/var/lib/kubelet/pods/690ea2d0-3693-4749-b62e-6230967a3b1d/volumes"
Sep 15 09:50:18.859368 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:18.859219    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db452d3b-4345-49f0-ab42-e436f1ea987c" path="/var/lib/kubelet/pods/db452d3b-4345-49f0-ab42-e436f1ea987c/volumes"
Sep 15 09:50:18.880584 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:18.880521    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"
Sep 15 09:50:18.880724 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:18.880521    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74" event={"ID":"1c092ea1-31da-4fb5-952d-22acfabfd4a8","Type":"ContainerDied","Data":"5c742e92273d8808bd2ed863f4f976cb7602a84f3e947a02a601f8b61fb032b3"}
Sep 15 09:50:18.880724 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:18.880686    2575 scope.go:117] "RemoveContainer" containerID="715167f0b07f5a5b089533639f162fe53b3da04c783212efce8656decf39aa51"
Sep 15 09:50:18.897110 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:18.897084    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"]
Sep 15 09:50:18.899309 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:18.899289    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b283ee-686c496f67-q6n74"]
Sep 15 09:50:20.860490 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:20.860459    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c092ea1-31da-4fb5-952d-22acfabfd4a8" path="/var/lib/kubelet/pods/1c092ea1-31da-4fb5-952d-22acfabfd4a8/volumes"
Sep 15 09:50:24.096023 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:24.095976    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:25.307307 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:25.307271    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:26.990463 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:26.990422    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d5f7f7fc6-p62cl"]
Sep 15 09:50:26.990944 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:26.990654    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-d5f7f7fc6-p62cl" podUID="69302caa-5f16-492a-8fbc-b0edbccb488f" containerName="manager" containerID="cri-o://09689571894f418b9dc7779aef6e2aa1a486fe9bde8140726698a526d6d7e874" gracePeriod=30
Sep 15 09:50:27.240962 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.240900    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d5f7f7fc6-p62cl"
Sep 15 09:50:27.359649 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.359618    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdtrz\" (UniqueName: \"kubernetes.io/projected/69302caa-5f16-492a-8fbc-b0edbccb488f-kube-api-access-tdtrz\") pod \"69302caa-5f16-492a-8fbc-b0edbccb488f\" (UID: \"69302caa-5f16-492a-8fbc-b0edbccb488f\") "
Sep 15 09:50:27.359649 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.359654    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69302caa-5f16-492a-8fbc-b0edbccb488f-metrics-certs\") pod \"69302caa-5f16-492a-8fbc-b0edbccb488f\" (UID: \"69302caa-5f16-492a-8fbc-b0edbccb488f\") "
Sep 15 09:50:27.359885 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.359683    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69302caa-5f16-492a-8fbc-b0edbccb488f-webhook-cert\") pod \"69302caa-5f16-492a-8fbc-b0edbccb488f\" (UID: \"69302caa-5f16-492a-8fbc-b0edbccb488f\") "
Sep 15 09:50:27.361997 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.361966    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69302caa-5f16-492a-8fbc-b0edbccb488f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "69302caa-5f16-492a-8fbc-b0edbccb488f" (UID: "69302caa-5f16-492a-8fbc-b0edbccb488f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:50:27.362124 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.361969    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69302caa-5f16-492a-8fbc-b0edbccb488f-kube-api-access-tdtrz" (OuterVolumeSpecName: "kube-api-access-tdtrz") pod "69302caa-5f16-492a-8fbc-b0edbccb488f" (UID: "69302caa-5f16-492a-8fbc-b0edbccb488f"). InnerVolumeSpecName "kube-api-access-tdtrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:50:27.362124 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.362015    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69302caa-5f16-492a-8fbc-b0edbccb488f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "69302caa-5f16-492a-8fbc-b0edbccb488f" (UID: "69302caa-5f16-492a-8fbc-b0edbccb488f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:50:27.460480 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.460453    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdtrz\" (UniqueName: \"kubernetes.io/projected/69302caa-5f16-492a-8fbc-b0edbccb488f-kube-api-access-tdtrz\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:27.460480 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.460479    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69302caa-5f16-492a-8fbc-b0edbccb488f-metrics-certs\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:27.460695 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.460494    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69302caa-5f16-492a-8fbc-b0edbccb488f-webhook-cert\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:50:27.930227 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.930190    2575 generic.go:356] "Generic (PLEG): container finished" podID="69302caa-5f16-492a-8fbc-b0edbccb488f" containerID="09689571894f418b9dc7779aef6e2aa1a486fe9bde8140726698a526d6d7e874" exitCode=0
Sep 15 09:50:27.930386 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.930239    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d5f7f7fc6-p62cl"
Sep 15 09:50:27.930386 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.930268    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d5f7f7fc6-p62cl" event={"ID":"69302caa-5f16-492a-8fbc-b0edbccb488f","Type":"ContainerDied","Data":"09689571894f418b9dc7779aef6e2aa1a486fe9bde8140726698a526d6d7e874"}
Sep 15 09:50:27.930386 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.930322    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d5f7f7fc6-p62cl" event={"ID":"69302caa-5f16-492a-8fbc-b0edbccb488f","Type":"ContainerDied","Data":"dc586fa7e7b9497f289164d470298e01cf697cff8cab5938e4f1a7b27e03feef"}
Sep 15 09:50:27.930386 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.930344    2575 scope.go:117] "RemoveContainer" containerID="09689571894f418b9dc7779aef6e2aa1a486fe9bde8140726698a526d6d7e874"
Sep 15 09:50:27.940880 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.940859    2575 scope.go:117] "RemoveContainer" containerID="09689571894f418b9dc7779aef6e2aa1a486fe9bde8140726698a526d6d7e874"
Sep 15 09:50:27.941177 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:50:27.941154    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09689571894f418b9dc7779aef6e2aa1a486fe9bde8140726698a526d6d7e874\": container with ID starting with 09689571894f418b9dc7779aef6e2aa1a486fe9bde8140726698a526d6d7e874 not found: ID does not exist" containerID="09689571894f418b9dc7779aef6e2aa1a486fe9bde8140726698a526d6d7e874"
Sep 15 09:50:27.941278 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.941184    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09689571894f418b9dc7779aef6e2aa1a486fe9bde8140726698a526d6d7e874"} err="failed to get container status \"09689571894f418b9dc7779aef6e2aa1a486fe9bde8140726698a526d6d7e874\": rpc error: code = NotFound desc = could not find container \"09689571894f418b9dc7779aef6e2aa1a486fe9bde8140726698a526d6d7e874\": container with ID starting with 09689571894f418b9dc7779aef6e2aa1a486fe9bde8140726698a526d6d7e874 not found: ID does not exist"
Sep 15 09:50:27.951525 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.951503    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d5f7f7fc6-p62cl"]
Sep 15 09:50:27.955190 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:27.955168    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d5f7f7fc6-p62cl"]
Sep 15 09:50:28.859120 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:28.859078    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69302caa-5f16-492a-8fbc-b0edbccb488f" path="/var/lib/kubelet/pods/69302caa-5f16-492a-8fbc-b0edbccb488f/volumes"
Sep 15 09:50:31.136445 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:31.136413    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:42.064066 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:42.064026    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:50:42.125389 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:50:42.125359    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:51:28.747975 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.747929    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d5f7f7fc6-dv7cp"]
Sep 15 09:51:28.748567 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748453    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c767bdb-daea-45af-b9d9-8a2dbbe254bd" containerName="istio-proxy"
Sep 15 09:51:28.748567 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748473    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c767bdb-daea-45af-b9d9-8a2dbbe254bd" containerName="istio-proxy"
Sep 15 09:51:28.748567 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748485    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c092ea1-31da-4fb5-952d-22acfabfd4a8" containerName="payload-processing"
Sep 15 09:51:28.748567 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748494    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c092ea1-31da-4fb5-952d-22acfabfd4a8" containerName="payload-processing"
Sep 15 09:51:28.748567 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748508    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69302caa-5f16-492a-8fbc-b0edbccb488f" containerName="manager"
Sep 15 09:51:28.748567 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748516    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="69302caa-5f16-492a-8fbc-b0edbccb488f" containerName="manager"
Sep 15 09:51:28.748567 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748528    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d2effad-1aa6-4a83-a1bd-807cfe037e32" containerName="payload-pre-processing"
Sep 15 09:51:28.748567 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748536    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d2effad-1aa6-4a83-a1bd-807cfe037e32" containerName="payload-pre-processing"
Sep 15 09:51:28.748567 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748546    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70359691-c652-491e-8de0-7c71b3e58811" containerName="istio-proxy"
Sep 15 09:51:28.748567 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748553    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="70359691-c652-491e-8de0-7c71b3e58811" containerName="istio-proxy"
Sep 15 09:51:28.749114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748574    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99f90804-00a1-4a56-9003-8090e29cb221" containerName="revoke-keys"
Sep 15 09:51:28.749114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748582    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="99f90804-00a1-4a56-9003-8090e29cb221" containerName="revoke-keys"
Sep 15 09:51:28.749114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748600    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="690ea2d0-3693-4749-b62e-6230967a3b1d" containerName="payload-pre-processing"
Sep 15 09:51:28.749114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748611    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="690ea2d0-3693-4749-b62e-6230967a3b1d" containerName="payload-pre-processing"
Sep 15 09:51:28.749114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748628    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c767bdb-daea-45af-b9d9-8a2dbbe254bd" containerName="istio-proxy"
Sep 15 09:51:28.749114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748636    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c767bdb-daea-45af-b9d9-8a2dbbe254bd" containerName="istio-proxy"
Sep 15 09:51:28.749114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748728    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c767bdb-daea-45af-b9d9-8a2dbbe254bd" containerName="istio-proxy"
Sep 15 09:51:28.749114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748740    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="690ea2d0-3693-4749-b62e-6230967a3b1d" containerName="payload-pre-processing"
Sep 15 09:51:28.749114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748750    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="99f90804-00a1-4a56-9003-8090e29cb221" containerName="revoke-keys"
Sep 15 09:51:28.749114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748779    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d2effad-1aa6-4a83-a1bd-807cfe037e32" containerName="payload-pre-processing"
Sep 15 09:51:28.749114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748789    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="70359691-c652-491e-8de0-7c71b3e58811" containerName="istio-proxy"
Sep 15 09:51:28.749114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748798    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c092ea1-31da-4fb5-952d-22acfabfd4a8" containerName="payload-processing"
Sep 15 09:51:28.749114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748806    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="70359691-c652-491e-8de0-7c71b3e58811" containerName="istio-proxy"
Sep 15 09:51:28.749114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.748816    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="69302caa-5f16-492a-8fbc-b0edbccb488f" containerName="manager"
Sep 15 09:51:28.752152 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.752119    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp"
Sep 15 09:51:28.755710 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.755683    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 09:51:28.755710 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.755707    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lqk66\""
Sep 15 09:51:28.755923 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.755707    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 09:51:28.755923 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.755728    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 09:51:28.761914 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.761891    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d5f7f7fc6-dv7cp"]
Sep 15 09:51:28.889381 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.889345    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9dd79763-a068-47e7-881b-34678fdf6b43-webhook-cert\") pod \"maas-controller-d5f7f7fc6-dv7cp\" (UID: \"9dd79763-a068-47e7-881b-34678fdf6b43\") " pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp"
Sep 15 09:51:28.889544 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.889390    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dd79763-a068-47e7-881b-34678fdf6b43-metrics-certs\") pod \"maas-controller-d5f7f7fc6-dv7cp\" (UID: \"9dd79763-a068-47e7-881b-34678fdf6b43\") " pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp"
Sep 15 09:51:28.889544 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.889460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x2bl\" (UniqueName: \"kubernetes.io/projected/9dd79763-a068-47e7-881b-34678fdf6b43-kube-api-access-6x2bl\") pod \"maas-controller-d5f7f7fc6-dv7cp\" (UID: \"9dd79763-a068-47e7-881b-34678fdf6b43\") " pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp"
Sep 15 09:51:28.990451 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.990417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x2bl\" (UniqueName: \"kubernetes.io/projected/9dd79763-a068-47e7-881b-34678fdf6b43-kube-api-access-6x2bl\") pod \"maas-controller-d5f7f7fc6-dv7cp\" (UID: \"9dd79763-a068-47e7-881b-34678fdf6b43\") " pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp"
Sep 15 09:51:28.990621 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.990498    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9dd79763-a068-47e7-881b-34678fdf6b43-webhook-cert\") pod \"maas-controller-d5f7f7fc6-dv7cp\" (UID: \"9dd79763-a068-47e7-881b-34678fdf6b43\") " pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp"
Sep 15 09:51:28.990621 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.990537    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dd79763-a068-47e7-881b-34678fdf6b43-metrics-certs\") pod \"maas-controller-d5f7f7fc6-dv7cp\" (UID: \"9dd79763-a068-47e7-881b-34678fdf6b43\") " pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp"
Sep 15 09:51:28.993279 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.993250    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dd79763-a068-47e7-881b-34678fdf6b43-metrics-certs\") pod \"maas-controller-d5f7f7fc6-dv7cp\" (UID: \"9dd79763-a068-47e7-881b-34678fdf6b43\") " pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp"
Sep 15 09:51:28.993403 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.993250    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9dd79763-a068-47e7-881b-34678fdf6b43-webhook-cert\") pod \"maas-controller-d5f7f7fc6-dv7cp\" (UID: \"9dd79763-a068-47e7-881b-34678fdf6b43\") " pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp"
Sep 15 09:51:28.998134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:28.998089    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x2bl\" (UniqueName: \"kubernetes.io/projected/9dd79763-a068-47e7-881b-34678fdf6b43-kube-api-access-6x2bl\") pod \"maas-controller-d5f7f7fc6-dv7cp\" (UID: \"9dd79763-a068-47e7-881b-34678fdf6b43\") " pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp"
Sep 15 09:51:29.063266 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:29.063233    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp"
Sep 15 09:51:29.333226 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:29.333203    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d5f7f7fc6-dv7cp"]
Sep 15 09:51:29.335529 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:51:29.335505    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dd79763_a068_47e7_881b_34678fdf6b43.slice/crio-4cbe1154c883dcafb726eeab5d7993af7a317d8647b343ea95234ad349cd4d93 WatchSource:0}: Error finding container 4cbe1154c883dcafb726eeab5d7993af7a317d8647b343ea95234ad349cd4d93: Status 404 returned error can't find the container with id 4cbe1154c883dcafb726eeab5d7993af7a317d8647b343ea95234ad349cd4d93
Sep 15 09:51:29.337245 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:29.337227    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:51:30.247261 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:30.247233    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp" event={"ID":"9dd79763-a068-47e7-881b-34678fdf6b43","Type":"ContainerStarted","Data":"40295c471d5cc3a16a5abb71852e96bf4488f3ca96c0362b36a2d029e99310d5"}
Sep 15 09:51:30.247602 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:30.247400    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp"
Sep 15 09:51:30.247602 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:30.247447    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp" event={"ID":"9dd79763-a068-47e7-881b-34678fdf6b43","Type":"ContainerStarted","Data":"4cbe1154c883dcafb726eeab5d7993af7a317d8647b343ea95234ad349cd4d93"}
Sep 15 09:51:30.264635 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:30.264596    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp" podStartSLOduration=1.421869732 podStartE2EDuration="2.264580923s" totalImagesPullingTime="842.711191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:51:30.263058561 +0000 UTC m=+2253.912474654" watchObservedRunningTime="2026-09-15 09:51:30.264580923 +0000 UTC m=+2253.913997015"
Sep 15 09:51:41.255734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:41.255696    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp"
Sep 15 09:51:52.769939 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:52.769889    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d5f7f7fc6-dv7cp"]
Sep 15 09:51:52.770422 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:52.770202    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp" podUID="9dd79763-a068-47e7-881b-34678fdf6b43" containerName="manager" containerID="cri-o://40295c471d5cc3a16a5abb71852e96bf4488f3ca96c0362b36a2d029e99310d5" gracePeriod=30
Sep 15 09:51:52.779684 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:52.779652    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:51:53.018978 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.018955    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp"
Sep 15 09:51:53.087566 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.087471    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9dd79763-a068-47e7-881b-34678fdf6b43-webhook-cert\") pod \"9dd79763-a068-47e7-881b-34678fdf6b43\" (UID: \"9dd79763-a068-47e7-881b-34678fdf6b43\") "
Sep 15 09:51:53.087566 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.087548    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6x2bl\" (UniqueName: \"kubernetes.io/projected/9dd79763-a068-47e7-881b-34678fdf6b43-kube-api-access-6x2bl\") pod \"9dd79763-a068-47e7-881b-34678fdf6b43\" (UID: \"9dd79763-a068-47e7-881b-34678fdf6b43\") "
Sep 15 09:51:53.087872 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.087577    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dd79763-a068-47e7-881b-34678fdf6b43-metrics-certs\") pod \"9dd79763-a068-47e7-881b-34678fdf6b43\" (UID: \"9dd79763-a068-47e7-881b-34678fdf6b43\") "
Sep 15 09:51:53.089676 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.089641    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dd79763-a068-47e7-881b-34678fdf6b43-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9dd79763-a068-47e7-881b-34678fdf6b43" (UID: "9dd79763-a068-47e7-881b-34678fdf6b43"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:51:53.090128 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.089730    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dd79763-a068-47e7-881b-34678fdf6b43-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9dd79763-a068-47e7-881b-34678fdf6b43" (UID: "9dd79763-a068-47e7-881b-34678fdf6b43"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:51:53.090128 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.089819    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dd79763-a068-47e7-881b-34678fdf6b43-kube-api-access-6x2bl" (OuterVolumeSpecName: "kube-api-access-6x2bl") pod "9dd79763-a068-47e7-881b-34678fdf6b43" (UID: "9dd79763-a068-47e7-881b-34678fdf6b43"). InnerVolumeSpecName "kube-api-access-6x2bl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:51:53.189297 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.189252    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6x2bl\" (UniqueName: \"kubernetes.io/projected/9dd79763-a068-47e7-881b-34678fdf6b43-kube-api-access-6x2bl\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:51:53.189297 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.189291    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dd79763-a068-47e7-881b-34678fdf6b43-metrics-certs\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:51:53.189297 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.189303    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9dd79763-a068-47e7-881b-34678fdf6b43-webhook-cert\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:51:53.368944 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.368852    2575 generic.go:356] "Generic (PLEG): container finished" podID="9dd79763-a068-47e7-881b-34678fdf6b43" containerID="40295c471d5cc3a16a5abb71852e96bf4488f3ca96c0362b36a2d029e99310d5" exitCode=0
Sep 15 09:51:53.368944 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.368904    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp"
Sep 15 09:51:53.368944 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.368918    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp" event={"ID":"9dd79763-a068-47e7-881b-34678fdf6b43","Type":"ContainerDied","Data":"40295c471d5cc3a16a5abb71852e96bf4488f3ca96c0362b36a2d029e99310d5"}
Sep 15 09:51:53.369166 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.368971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d5f7f7fc6-dv7cp" event={"ID":"9dd79763-a068-47e7-881b-34678fdf6b43","Type":"ContainerDied","Data":"4cbe1154c883dcafb726eeab5d7993af7a317d8647b343ea95234ad349cd4d93"}
Sep 15 09:51:53.369166 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.369001    2575 scope.go:117] "RemoveContainer" containerID="40295c471d5cc3a16a5abb71852e96bf4488f3ca96c0362b36a2d029e99310d5"
Sep 15 09:51:53.378897 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.378879    2575 scope.go:117] "RemoveContainer" containerID="40295c471d5cc3a16a5abb71852e96bf4488f3ca96c0362b36a2d029e99310d5"
Sep 15 09:51:53.379209 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:51:53.379186    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40295c471d5cc3a16a5abb71852e96bf4488f3ca96c0362b36a2d029e99310d5\": container with ID starting with 40295c471d5cc3a16a5abb71852e96bf4488f3ca96c0362b36a2d029e99310d5 not found: ID does not exist" containerID="40295c471d5cc3a16a5abb71852e96bf4488f3ca96c0362b36a2d029e99310d5"
Sep 15 09:51:53.379300 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.379217    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40295c471d5cc3a16a5abb71852e96bf4488f3ca96c0362b36a2d029e99310d5"} err="failed to get container status \"40295c471d5cc3a16a5abb71852e96bf4488f3ca96c0362b36a2d029e99310d5\": rpc error: code = NotFound desc = could not find container \"40295c471d5cc3a16a5abb71852e96bf4488f3ca96c0362b36a2d029e99310d5\": container with ID starting with 40295c471d5cc3a16a5abb71852e96bf4488f3ca96c0362b36a2d029e99310d5 not found: ID does not exist"
Sep 15 09:51:53.390287 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.390266    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d5f7f7fc6-dv7cp"]
Sep 15 09:51:53.393752 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:53.393726    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d5f7f7fc6-dv7cp"]
Sep 15 09:51:54.059342 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.059302    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:51:54.174866 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.174835    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d5f7f7fc6-64m6z"]
Sep 15 09:51:54.175219 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.175208    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dd79763-a068-47e7-881b-34678fdf6b43" containerName="manager"
Sep 15 09:51:54.175262 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.175222    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd79763-a068-47e7-881b-34678fdf6b43" containerName="manager"
Sep 15 09:51:54.175262 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.175239    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70359691-c652-491e-8de0-7c71b3e58811" containerName="istio-proxy"
Sep 15 09:51:54.175262 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.175244    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="70359691-c652-491e-8de0-7c71b3e58811" containerName="istio-proxy"
Sep 15 09:51:54.175361 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.175316    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dd79763-a068-47e7-881b-34678fdf6b43" containerName="manager"
Sep 15 09:51:54.175361 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.175325    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c767bdb-daea-45af-b9d9-8a2dbbe254bd" containerName="istio-proxy"
Sep 15 09:51:54.179685 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.179666    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d5f7f7fc6-64m6z"
Sep 15 09:51:54.183136 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.183114    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lqk66\""
Sep 15 09:51:54.183269 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.183157    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 09:51:54.183269 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.183174    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 09:51:54.183269 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.183116    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 09:51:54.188499 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.188478    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d5f7f7fc6-64m6z"]
Sep 15 09:51:54.198401 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.198373    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b43e136-b50a-4256-aa38-21d88f6dbec0-webhook-cert\") pod \"maas-controller-d5f7f7fc6-64m6z\" (UID: \"7b43e136-b50a-4256-aa38-21d88f6dbec0\") " pod="opendatahub/maas-controller-d5f7f7fc6-64m6z"
Sep 15 09:51:54.198528 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.198430    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp882\" (UniqueName: \"kubernetes.io/projected/7b43e136-b50a-4256-aa38-21d88f6dbec0-kube-api-access-pp882\") pod \"maas-controller-d5f7f7fc6-64m6z\" (UID: \"7b43e136-b50a-4256-aa38-21d88f6dbec0\") " pod="opendatahub/maas-controller-d5f7f7fc6-64m6z"
Sep 15 09:51:54.198602 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.198560    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b43e136-b50a-4256-aa38-21d88f6dbec0-metrics-certs\") pod \"maas-controller-d5f7f7fc6-64m6z\" (UID: \"7b43e136-b50a-4256-aa38-21d88f6dbec0\") " pod="opendatahub/maas-controller-d5f7f7fc6-64m6z"
Sep 15 09:51:54.299796 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.299736    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b43e136-b50a-4256-aa38-21d88f6dbec0-metrics-certs\") pod \"maas-controller-d5f7f7fc6-64m6z\" (UID: \"7b43e136-b50a-4256-aa38-21d88f6dbec0\") " pod="opendatahub/maas-controller-d5f7f7fc6-64m6z"
Sep 15 09:51:54.299960 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.299833    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b43e136-b50a-4256-aa38-21d88f6dbec0-webhook-cert\") pod \"maas-controller-d5f7f7fc6-64m6z\" (UID: \"7b43e136-b50a-4256-aa38-21d88f6dbec0\") " pod="opendatahub/maas-controller-d5f7f7fc6-64m6z"
Sep 15 09:51:54.299960 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.299869    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp882\" (UniqueName: \"kubernetes.io/projected/7b43e136-b50a-4256-aa38-21d88f6dbec0-kube-api-access-pp882\") pod \"maas-controller-d5f7f7fc6-64m6z\" (UID: \"7b43e136-b50a-4256-aa38-21d88f6dbec0\") " pod="opendatahub/maas-controller-d5f7f7fc6-64m6z"
Sep 15 09:51:54.302422 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.302401    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b43e136-b50a-4256-aa38-21d88f6dbec0-metrics-certs\") pod \"maas-controller-d5f7f7fc6-64m6z\" (UID: \"7b43e136-b50a-4256-aa38-21d88f6dbec0\") " pod="opendatahub/maas-controller-d5f7f7fc6-64m6z"
Sep 15 09:51:54.302561 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.302537    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b43e136-b50a-4256-aa38-21d88f6dbec0-webhook-cert\") pod \"maas-controller-d5f7f7fc6-64m6z\" (UID: \"7b43e136-b50a-4256-aa38-21d88f6dbec0\") " pod="opendatahub/maas-controller-d5f7f7fc6-64m6z"
Sep 15 09:51:54.308281 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.308258    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp882\" (UniqueName: \"kubernetes.io/projected/7b43e136-b50a-4256-aa38-21d88f6dbec0-kube-api-access-pp882\") pod \"maas-controller-d5f7f7fc6-64m6z\" (UID: \"7b43e136-b50a-4256-aa38-21d88f6dbec0\") " pod="opendatahub/maas-controller-d5f7f7fc6-64m6z"
Sep 15 09:51:54.491666 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.491627    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d5f7f7fc6-64m6z"
Sep 15 09:51:54.762416 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.762393    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d5f7f7fc6-64m6z"]
Sep 15 09:51:54.765531 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:51:54.765506    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b43e136_b50a_4256_aa38_21d88f6dbec0.slice/crio-6d8bf8119a7a28ab05e83dc6feecbf6779f88bd9ee658ac9440a5cbee2495261 WatchSource:0}: Error finding container 6d8bf8119a7a28ab05e83dc6feecbf6779f88bd9ee658ac9440a5cbee2495261: Status 404 returned error can't find the container with id 6d8bf8119a7a28ab05e83dc6feecbf6779f88bd9ee658ac9440a5cbee2495261
Sep 15 09:51:54.859477 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:54.859447    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dd79763-a068-47e7-881b-34678fdf6b43" path="/var/lib/kubelet/pods/9dd79763-a068-47e7-881b-34678fdf6b43/volumes"
Sep 15 09:51:55.381901 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:55.381858    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d5f7f7fc6-64m6z" event={"ID":"7b43e136-b50a-4256-aa38-21d88f6dbec0","Type":"ContainerStarted","Data":"803de8b508989400657aac0edb6c0f4ecdb4e8e9ad2c64a7f89141cbf31d8d18"}
Sep 15 09:51:55.382349 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:55.381937    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d5f7f7fc6-64m6z" event={"ID":"7b43e136-b50a-4256-aa38-21d88f6dbec0","Type":"ContainerStarted","Data":"6d8bf8119a7a28ab05e83dc6feecbf6779f88bd9ee658ac9440a5cbee2495261"}
Sep 15 09:51:55.382349 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:55.381991    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d5f7f7fc6-64m6z"
Sep 15 09:51:55.398135 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:55.398087    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d5f7f7fc6-64m6z" podStartSLOduration=0.981799549 podStartE2EDuration="1.398071475s" totalImagesPullingTime="416.271926ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:51:55.396819567 +0000 UTC m=+2279.046235651" watchObservedRunningTime="2026-09-15 09:51:55.398071475 +0000 UTC m=+2279.047487567"
Sep 15 09:51:57.342012 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:57.341982    2575 scope.go:117] "RemoveContainer" containerID="bfc67ce0da2dc73f317bc6db69bfd4bc445d634d15777426b3b65e96c84fcde0"
Sep 15 09:51:57.350508 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:51:57.350489    2575 scope.go:117] "RemoveContainer" containerID="024d0c4e825cf7c735119e6c665db16f3c7b73feb6c0864c597fc4ab953079c5"
Sep 15 09:52:06.389465 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:52:06.389430    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d5f7f7fc6-64m6z"
Sep 15 09:52:20.644970 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:52:20.644937    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:52:20.744898 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:52:20.744861    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:53:13.051094 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.051057    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"]
Sep 15 09:53:13.053362 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.051300    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r" podUID="63912ac3-b78a-455c-b0bc-5a6f22b47ba4" containerName="manager" containerID="cri-o://89b38f73756a064690f96ae7204ccfa6c486d2bf66f0c0ab74fbe3bccc9a5a25" gracePeriod=10
Sep 15 09:53:13.304550 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.304476    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"
Sep 15 09:53:13.307553 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.307530    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63912ac3-b78a-455c-b0bc-5a6f22b47ba4-extensions-socket-volume\") pod \"63912ac3-b78a-455c-b0bc-5a6f22b47ba4\" (UID: \"63912ac3-b78a-455c-b0bc-5a6f22b47ba4\") "
Sep 15 09:53:13.307644 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.307580    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg4dz\" (UniqueName: \"kubernetes.io/projected/63912ac3-b78a-455c-b0bc-5a6f22b47ba4-kube-api-access-kg4dz\") pod \"63912ac3-b78a-455c-b0bc-5a6f22b47ba4\" (UID: \"63912ac3-b78a-455c-b0bc-5a6f22b47ba4\") "
Sep 15 09:53:13.307904 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.307883    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63912ac3-b78a-455c-b0bc-5a6f22b47ba4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "63912ac3-b78a-455c-b0bc-5a6f22b47ba4" (UID: "63912ac3-b78a-455c-b0bc-5a6f22b47ba4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:53:13.309896 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.309862    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63912ac3-b78a-455c-b0bc-5a6f22b47ba4-kube-api-access-kg4dz" (OuterVolumeSpecName: "kube-api-access-kg4dz") pod "63912ac3-b78a-455c-b0bc-5a6f22b47ba4" (UID: "63912ac3-b78a-455c-b0bc-5a6f22b47ba4"). InnerVolumeSpecName "kube-api-access-kg4dz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:53:13.408372 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.408340    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/63912ac3-b78a-455c-b0bc-5a6f22b47ba4-extensions-socket-volume\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:53:13.408372 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.408370    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg4dz\" (UniqueName: \"kubernetes.io/projected/63912ac3-b78a-455c-b0bc-5a6f22b47ba4-kube-api-access-kg4dz\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:53:13.769887 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.769856    2575 generic.go:356] "Generic (PLEG): container finished" podID="63912ac3-b78a-455c-b0bc-5a6f22b47ba4" containerID="89b38f73756a064690f96ae7204ccfa6c486d2bf66f0c0ab74fbe3bccc9a5a25" exitCode=0
Sep 15 09:53:13.770061 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.769903    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"
Sep 15 09:53:13.770061 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.769917    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r" event={"ID":"63912ac3-b78a-455c-b0bc-5a6f22b47ba4","Type":"ContainerDied","Data":"89b38f73756a064690f96ae7204ccfa6c486d2bf66f0c0ab74fbe3bccc9a5a25"}
Sep 15 09:53:13.770061 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.769987    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r" event={"ID":"63912ac3-b78a-455c-b0bc-5a6f22b47ba4","Type":"ContainerDied","Data":"81741e4c937b9c860d27541bb2694a6dfef52ed0a6c9bb51f28e72515dc1754b"}
Sep 15 09:53:13.770061 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.770008    2575 scope.go:117] "RemoveContainer" containerID="89b38f73756a064690f96ae7204ccfa6c486d2bf66f0c0ab74fbe3bccc9a5a25"
Sep 15 09:53:13.779551 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.779532    2575 scope.go:117] "RemoveContainer" containerID="f9ee47cce25573d5b3ddd608bc326ece82d273456b87f653f56fce46085e579b"
Sep 15 09:53:13.787801 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.787788    2575 scope.go:117] "RemoveContainer" containerID="89b38f73756a064690f96ae7204ccfa6c486d2bf66f0c0ab74fbe3bccc9a5a25"
Sep 15 09:53:13.788056 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:53:13.788035    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89b38f73756a064690f96ae7204ccfa6c486d2bf66f0c0ab74fbe3bccc9a5a25\": container with ID starting with 89b38f73756a064690f96ae7204ccfa6c486d2bf66f0c0ab74fbe3bccc9a5a25 not found: ID does not exist" containerID="89b38f73756a064690f96ae7204ccfa6c486d2bf66f0c0ab74fbe3bccc9a5a25"
Sep 15 09:53:13.788131 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.788062    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89b38f73756a064690f96ae7204ccfa6c486d2bf66f0c0ab74fbe3bccc9a5a25"} err="failed to get container status \"89b38f73756a064690f96ae7204ccfa6c486d2bf66f0c0ab74fbe3bccc9a5a25\": rpc error: code = NotFound desc = could not find container \"89b38f73756a064690f96ae7204ccfa6c486d2bf66f0c0ab74fbe3bccc9a5a25\": container with ID starting with 89b38f73756a064690f96ae7204ccfa6c486d2bf66f0c0ab74fbe3bccc9a5a25 not found: ID does not exist"
Sep 15 09:53:13.788131 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.788078    2575 scope.go:117] "RemoveContainer" containerID="f9ee47cce25573d5b3ddd608bc326ece82d273456b87f653f56fce46085e579b"
Sep 15 09:53:13.788331 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:53:13.788313    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9ee47cce25573d5b3ddd608bc326ece82d273456b87f653f56fce46085e579b\": container with ID starting with f9ee47cce25573d5b3ddd608bc326ece82d273456b87f653f56fce46085e579b not found: ID does not exist" containerID="f9ee47cce25573d5b3ddd608bc326ece82d273456b87f653f56fce46085e579b"
Sep 15 09:53:13.788394 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.788338    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9ee47cce25573d5b3ddd608bc326ece82d273456b87f653f56fce46085e579b"} err="failed to get container status \"f9ee47cce25573d5b3ddd608bc326ece82d273456b87f653f56fce46085e579b\": rpc error: code = NotFound desc = could not find container \"f9ee47cce25573d5b3ddd608bc326ece82d273456b87f653f56fce46085e579b\": container with ID starting with f9ee47cce25573d5b3ddd608bc326ece82d273456b87f653f56fce46085e579b not found: ID does not exist"
Sep 15 09:53:13.791457 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.791436    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"]
Sep 15 09:53:13.794897 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:13.794876    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6x2r"]
Sep 15 09:53:14.857938 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:14.857901    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63912ac3-b78a-455c-b0bc-5a6f22b47ba4" path="/var/lib/kubelet/pods/63912ac3-b78a-455c-b0bc-5a6f22b47ba4/volumes"
Sep 15 09:53:25.685018 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:25.684983    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:53:25.740919 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:25.740889    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:53:48.174511 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:48.174478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:53:49.768557 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:49.768522    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:53:57.029547 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:57.029517    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:53:57.033868 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:57.033845    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:53:57.035314 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:57.035293    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:53:57.039478 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:57.039460    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hj965_dc865b47-353d-48c1-b3c4-8c51fbc97e44/ovn-acl-logging/0.log"
Sep 15 09:53:57.304154 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:53:57.304075    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:54:13.722994 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:13.722960    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6vvt7"]
Sep 15 09:54:13.723440 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:13.723318    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63912ac3-b78a-455c-b0bc-5a6f22b47ba4" containerName="manager"
Sep 15 09:54:13.723440 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:13.723328    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="63912ac3-b78a-455c-b0bc-5a6f22b47ba4" containerName="manager"
Sep 15 09:54:13.723440 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:13.723336    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63912ac3-b78a-455c-b0bc-5a6f22b47ba4" containerName="manager"
Sep 15 09:54:13.723440 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:13.723343    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="63912ac3-b78a-455c-b0bc-5a6f22b47ba4" containerName="manager"
Sep 15 09:54:13.723440 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:13.723397    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="63912ac3-b78a-455c-b0bc-5a6f22b47ba4" containerName="manager"
Sep 15 09:54:13.723440 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:13.723405    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="63912ac3-b78a-455c-b0bc-5a6f22b47ba4" containerName="manager"
Sep 15 09:54:13.726361 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:13.726344    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6vvt7"
Sep 15 09:54:13.729061 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:13.729036    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2rwrt\""
Sep 15 09:54:13.737636 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:13.737610    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6vvt7"]
Sep 15 09:54:13.825468 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:13.825439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f998df5e-f29e-49de-bff9-2519cfd61498-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6vvt7\" (UID: \"f998df5e-f29e-49de-bff9-2519cfd61498\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6vvt7"
Sep 15 09:54:13.825649 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:13.825496    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2ksl\" (UniqueName: \"kubernetes.io/projected/f998df5e-f29e-49de-bff9-2519cfd61498-kube-api-access-n2ksl\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6vvt7\" (UID: \"f998df5e-f29e-49de-bff9-2519cfd61498\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6vvt7"
Sep 15 09:54:13.926252 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:13.926206    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f998df5e-f29e-49de-bff9-2519cfd61498-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6vvt7\" (UID: \"f998df5e-f29e-49de-bff9-2519cfd61498\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6vvt7"
Sep 15 09:54:13.926454 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:13.926280    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2ksl\" (UniqueName: \"kubernetes.io/projected/f998df5e-f29e-49de-bff9-2519cfd61498-kube-api-access-n2ksl\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6vvt7\" (UID: \"f998df5e-f29e-49de-bff9-2519cfd61498\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6vvt7"
Sep 15 09:54:13.926647 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:13.926623    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f998df5e-f29e-49de-bff9-2519cfd61498-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6vvt7\" (UID: \"f998df5e-f29e-49de-bff9-2519cfd61498\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6vvt7"
Sep 15 09:54:13.935318 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:13.935293    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2ksl\" (UniqueName: \"kubernetes.io/projected/f998df5e-f29e-49de-bff9-2519cfd61498-kube-api-access-n2ksl\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6vvt7\" (UID: \"f998df5e-f29e-49de-bff9-2519cfd61498\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6vvt7"
Sep 15 09:54:14.036469 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:14.036397    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6vvt7"
Sep 15 09:54:14.328165 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:14.328137    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6vvt7"]
Sep 15 09:54:14.330288 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:54:14.330260    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf998df5e_f29e_49de_bff9_2519cfd61498.slice/crio-d5b7611347d114ef79a7b3203296731cf6f27be633a42c86f6595309d4deebc4 WatchSource:0}: Error finding container d5b7611347d114ef79a7b3203296731cf6f27be633a42c86f6595309d4deebc4: Status 404 returned error can't find the container with id d5b7611347d114ef79a7b3203296731cf6f27be633a42c86f6595309d4deebc4
Sep 15 09:54:15.071135 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:15.071095    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6vvt7" event={"ID":"f998df5e-f29e-49de-bff9-2519cfd61498","Type":"ContainerStarted","Data":"a652aa55559db06d18755416aba055c29d587c1a3dc4c5ac7b8de2067df83401"}
Sep 15 09:54:15.071508 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:15.071154    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6vvt7" event={"ID":"f998df5e-f29e-49de-bff9-2519cfd61498","Type":"ContainerStarted","Data":"d5b7611347d114ef79a7b3203296731cf6f27be633a42c86f6595309d4deebc4"}
Sep 15 09:54:15.071508 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:15.071181    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6vvt7"
Sep 15 09:54:15.095564 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:15.095520    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6vvt7" podStartSLOduration=2.095504338 podStartE2EDuration="2.095504338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:54:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:54:15.093417073 +0000 UTC m=+2418.742833166" watchObservedRunningTime="2026-09-15 09:54:15.095504338 +0000 UTC m=+2418.744920431"
Sep 15 09:54:26.078552 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:26.078522    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6vvt7"
Sep 15 09:54:50.584905 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.584872    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"]
Sep 15 09:54:50.588669 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.588648    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.590780 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.590746    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-52753c93-kserve-self-signed-certs\""
Sep 15 09:54:50.596118 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.596091    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"]
Sep 15 09:54:50.707147 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.707116    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:54:50.745649 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.745616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-dshm\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.745857 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.745664    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4vxn\" (UniqueName: \"kubernetes.io/projected/9c437e18-45d7-44cd-81a0-286fca59821d-kube-api-access-g4vxn\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.745857 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.745843    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-model-cache\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.745988 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.745888    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c437e18-45d7-44cd-81a0-286fca59821d-tls-certs\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.745988 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.745973    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-home\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.746092 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.746010    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-tmp-dir\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.847543 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.847450    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-tmp-dir\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.847543 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.847487    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-dshm\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.847543 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.847514    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4vxn\" (UniqueName: \"kubernetes.io/projected/9c437e18-45d7-44cd-81a0-286fca59821d-kube-api-access-g4vxn\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.847845 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.847580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-model-cache\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.847845 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.847606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c437e18-45d7-44cd-81a0-286fca59821d-tls-certs\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.847845 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.847671    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-home\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.848020 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.847925    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-tmp-dir\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.848020 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.847965    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-model-cache\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.848128 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.848088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-home\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.850375 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.850344    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-dshm\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.850492 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.850418    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c437e18-45d7-44cd-81a0-286fca59821d-tls-certs\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.855055 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.855034    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4vxn\" (UniqueName: \"kubernetes.io/projected/9c437e18-45d7-44cd-81a0-286fca59821d-kube-api-access-g4vxn\") pod \"e2e-same-id-a-52753c93-kserve-65f687d467-955c7\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") " pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:50.898769 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:50.898746    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:54:51.174360 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:51.174326    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"]
Sep 15 09:54:51.176516 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:54:51.176486    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c437e18_45d7_44cd_81a0_286fca59821d.slice/crio-8caf08976b76204b6285025988d686f89175e74751af45d7a0d5f014f2c48ebc WatchSource:0}: Error finding container 8caf08976b76204b6285025988d686f89175e74751af45d7a0d5f014f2c48ebc: Status 404 returned error can't find the container with id 8caf08976b76204b6285025988d686f89175e74751af45d7a0d5f014f2c48ebc
Sep 15 09:54:51.249790 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:51.249750    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7" event={"ID":"9c437e18-45d7-44cd-81a0-286fca59821d","Type":"ContainerStarted","Data":"95aa22aa36296fa40274137f63d2f2ee116d5ba7da2dce1e3748241ed835bf94"}
Sep 15 09:54:51.249943 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:51.249809    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7" event={"ID":"9c437e18-45d7-44cd-81a0-286fca59821d","Type":"ContainerStarted","Data":"8caf08976b76204b6285025988d686f89175e74751af45d7a0d5f014f2c48ebc"}
Sep 15 09:54:51.266049 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:51.266003    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7" podStartSLOduration=1.265985207 podStartE2EDuration="1.265985207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:54:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:54:51.26485342 +0000 UTC m=+2454.914269512" watchObservedRunningTime="2026-09-15 09:54:51.265985207 +0000 UTC m=+2454.915401300"
Sep 15 09:54:57.402392 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:57.402359    2575 scope.go:117] "RemoveContainer" containerID="d3af8eb44c0dd4bbfd4990191ef3d1b258c952756920e79da22488d88a7de579"
Sep 15 09:54:57.410918 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:54:57.410899    2575 scope.go:117] "RemoveContainer" containerID="ecb7fe7c9cc13744af3c93f1a5e19a9e027f1155ae735646f72f6b5f5a0e019c"
Sep 15 09:55:00.899128 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:00.899093    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:55:00.899547 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:00.899147    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:55:00.911889 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:00.911867    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:55:01.311643 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:01.311566    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:55:05.432409 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:05.432378    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:55:32.898648 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:32.898613    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"]
Sep 15 09:55:32.922230 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:32.922207    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:55:34.930262 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:34.930230    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:55:47.921240 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:47.921137    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7" podUID="9c437e18-45d7-44cd-81a0-286fca59821d" containerName="main" containerID="cri-o://95aa22aa36296fa40274137f63d2f2ee116d5ba7da2dce1e3748241ed835bf94" gracePeriod=45
Sep 15 09:55:48.184516 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.184456    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:55:48.244358 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.244324    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-model-cache\") pod \"9c437e18-45d7-44cd-81a0-286fca59821d\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") "
Sep 15 09:55:48.244542 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.244374    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c437e18-45d7-44cd-81a0-286fca59821d-tls-certs\") pod \"9c437e18-45d7-44cd-81a0-286fca59821d\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") "
Sep 15 09:55:48.244542 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.244406    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-tmp-dir\") pod \"9c437e18-45d7-44cd-81a0-286fca59821d\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") "
Sep 15 09:55:48.244542 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.244457    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-dshm\") pod \"9c437e18-45d7-44cd-81a0-286fca59821d\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") "
Sep 15 09:55:48.244542 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.244477    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-home\") pod \"9c437e18-45d7-44cd-81a0-286fca59821d\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") "
Sep 15 09:55:48.244787 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.244571    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4vxn\" (UniqueName: \"kubernetes.io/projected/9c437e18-45d7-44cd-81a0-286fca59821d-kube-api-access-g4vxn\") pod \"9c437e18-45d7-44cd-81a0-286fca59821d\" (UID: \"9c437e18-45d7-44cd-81a0-286fca59821d\") "
Sep 15 09:55:48.244787 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.244652    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-model-cache" (OuterVolumeSpecName: "model-cache") pod "9c437e18-45d7-44cd-81a0-286fca59821d" (UID: "9c437e18-45d7-44cd-81a0-286fca59821d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:55:48.244787 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.244685    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9c437e18-45d7-44cd-81a0-286fca59821d" (UID: "9c437e18-45d7-44cd-81a0-286fca59821d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:55:48.244787 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.244744    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-home" (OuterVolumeSpecName: "home") pod "9c437e18-45d7-44cd-81a0-286fca59821d" (UID: "9c437e18-45d7-44cd-81a0-286fca59821d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:55:48.244998 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.244964    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-model-cache\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:55:48.244998 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.244984    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-tmp-dir\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:55:48.244998 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.244995    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-home\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:55:48.246934 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.246910    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c437e18-45d7-44cd-81a0-286fca59821d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9c437e18-45d7-44cd-81a0-286fca59821d" (UID: "9c437e18-45d7-44cd-81a0-286fca59821d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:55:48.247074 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.246963    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-dshm" (OuterVolumeSpecName: "dshm") pod "9c437e18-45d7-44cd-81a0-286fca59821d" (UID: "9c437e18-45d7-44cd-81a0-286fca59821d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:55:48.247074 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.246967    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c437e18-45d7-44cd-81a0-286fca59821d-kube-api-access-g4vxn" (OuterVolumeSpecName: "kube-api-access-g4vxn") pod "9c437e18-45d7-44cd-81a0-286fca59821d" (UID: "9c437e18-45d7-44cd-81a0-286fca59821d"). InnerVolumeSpecName "kube-api-access-g4vxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:55:48.345647 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.345617    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c437e18-45d7-44cd-81a0-286fca59821d-dshm\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:55:48.345647 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.345643    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4vxn\" (UniqueName: \"kubernetes.io/projected/9c437e18-45d7-44cd-81a0-286fca59821d-kube-api-access-g4vxn\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:55:48.345647 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.345654    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c437e18-45d7-44cd-81a0-286fca59821d-tls-certs\") on node \"ip-10-0-136-31.ec2.internal\" DevicePath \"\""
Sep 15 09:55:48.543311 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.543211    2575 generic.go:356] "Generic (PLEG): container finished" podID="9c437e18-45d7-44cd-81a0-286fca59821d" containerID="95aa22aa36296fa40274137f63d2f2ee116d5ba7da2dce1e3748241ed835bf94" exitCode=0
Sep 15 09:55:48.543311 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.543282    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"
Sep 15 09:55:48.543311 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.543301    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7" event={"ID":"9c437e18-45d7-44cd-81a0-286fca59821d","Type":"ContainerDied","Data":"95aa22aa36296fa40274137f63d2f2ee116d5ba7da2dce1e3748241ed835bf94"}
Sep 15 09:55:48.543595 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.543342    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7" event={"ID":"9c437e18-45d7-44cd-81a0-286fca59821d","Type":"ContainerDied","Data":"8caf08976b76204b6285025988d686f89175e74751af45d7a0d5f014f2c48ebc"}
Sep 15 09:55:48.543595 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.543356    2575 scope.go:117] "RemoveContainer" containerID="95aa22aa36296fa40274137f63d2f2ee116d5ba7da2dce1e3748241ed835bf94"
Sep 15 09:55:48.553290 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.553250    2575 scope.go:117] "RemoveContainer" containerID="95aa22aa36296fa40274137f63d2f2ee116d5ba7da2dce1e3748241ed835bf94"
Sep 15 09:55:48.553661 ip-10-0-136-31 kubenswrapper[2575]: E0915 09:55:48.553577    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95aa22aa36296fa40274137f63d2f2ee116d5ba7da2dce1e3748241ed835bf94\": container with ID starting with 95aa22aa36296fa40274137f63d2f2ee116d5ba7da2dce1e3748241ed835bf94 not found: ID does not exist" containerID="95aa22aa36296fa40274137f63d2f2ee116d5ba7da2dce1e3748241ed835bf94"
Sep 15 09:55:48.553661 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.553613    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95aa22aa36296fa40274137f63d2f2ee116d5ba7da2dce1e3748241ed835bf94"} err="failed to get container status \"95aa22aa36296fa40274137f63d2f2ee116d5ba7da2dce1e3748241ed835bf94\": rpc error: code = NotFound desc = could not find container \"95aa22aa36296fa40274137f63d2f2ee116d5ba7da2dce1e3748241ed835bf94\": container with ID starting with 95aa22aa36296fa40274137f63d2f2ee116d5ba7da2dce1e3748241ed835bf94 not found: ID does not exist"
Sep 15 09:55:48.596592 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.596563    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"]
Sep 15 09:55:48.609340 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.609312    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-52753c93-kserve-65f687d467-955c7"]
Sep 15 09:55:48.860613 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:48.860534    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c437e18-45d7-44cd-81a0-286fca59821d" path="/var/lib/kubelet/pods/9c437e18-45d7-44cd-81a0-286fca59821d/volumes"
Sep 15 09:55:57.433576 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:57.433545    2575 scope.go:117] "RemoveContainer" containerID="33a6c0a4f8469a5b96ac3545541ed616afce7931981bed23e3d9262acfc80cef"
Sep 15 09:55:57.441976 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:55:57.441952    2575 scope.go:117] "RemoveContainer" containerID="5948d67db07138a5c43ba495e692655cedd05f0d56815e12bf28096ff56d49a1"
Sep 15 09:56:30.943805 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:30.943742    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c4f5f6dd-krqn4_55afdde3-1232-4b3c-9cfc-da32d15b333b/authorino/0.log"
Sep 15 09:56:36.193957 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:36.193917    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7trbv_2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac/manager/0.log"
Sep 15 09:56:36.311249 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:36.311219    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xgr86_431f5053-0f35-4cb5-920f-848f2a7d9292/manager/0.log"
Sep 15 09:56:36.435332 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:36.435303    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d5f7f7fc6-64m6z_7b43e136-b50a-4256-aa38-21d88f6dbec0/manager/0.log"
Sep 15 09:56:37.071501 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:37.071477    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-767c4c8b76-spbm4_4dd31bb8-7087-4944-a536-f8354456be9d/copy-manifests/0.log"
Sep 15 09:56:37.078220 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:37.078199    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-767c4c8b76-spbm4_4dd31bb8-7087-4944-a536-f8354456be9d/manager/0.log"
Sep 15 09:56:37.883348 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:37.883320    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-v5ldt_e7b72d0e-2a08-42ac-9bd7-411d9c517311/postgres/0.log"
Sep 15 09:56:38.674620 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:38.674591    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c4f5f6dd-krqn4_55afdde3-1232-4b3c-9cfc-da32d15b333b/authorino/0.log"
Sep 15 09:56:38.785143 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:38.785109    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-vdj8k_94c16614-2426-4abf-bf94-fb8ceedeba8c/manager/0.log"
Sep 15 09:56:39.132250 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:39.132180    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-6vvt7_f998df5e-f29e-49de-bff9-2519cfd61498/manager/0.log"
Sep 15 09:56:39.365580 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:39.365548    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-v4k4g_38567e1e-1f7e-4819-9f8c-f1d4d6de10ef/manager/0.log"
Sep 15 09:56:39.946296 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:39.946273    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6df85cfc68-4l796_d7a7c868-50a9-4e91-906c-0884d05de98e/kube-auth-proxy/0.log"
Sep 15 09:56:40.305880 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:40.305809    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-szd7z_64ea1d0e-c8c9-4b1f-babe-11a283e0538e/payload-pre-processing/0.log"
Sep 15 09:56:40.415164 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:40.415133    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pljbs_9fcbe6bc-94d4-4557-bb35-1e664c775fa0/payload-processing/0.log"
Sep 15 09:56:40.532444 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:40.532416    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5995ff59fb-4rbww_49237773-7a17-4886-b757-650adf21b082/router/0.log"
Sep 15 09:56:41.108040 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:41.108016    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-t5hz6_d34a2217-1c7c-4ddc-afe3-4ffe4e60bc8b/main/0.log"
Sep 15 09:56:41.221871 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:41.221841    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-drjqk_f95f7748-f49d-4602-8478-7cd686e23d8f/main/0.log"
Sep 15 09:56:47.212675 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.212637    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tznnh/must-gather-6r8q9"]
Sep 15 09:56:47.213172 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.213093    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c437e18-45d7-44cd-81a0-286fca59821d" containerName="main"
Sep 15 09:56:47.213172 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.213106    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c437e18-45d7-44cd-81a0-286fca59821d" containerName="main"
Sep 15 09:56:47.213172 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.213165    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c437e18-45d7-44cd-81a0-286fca59821d" containerName="main"
Sep 15 09:56:47.216341 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.216324    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tznnh/must-gather-6r8q9"
Sep 15 09:56:47.220408 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.220373    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tznnh\"/\"kube-root-ca.crt\""
Sep 15 09:56:47.220408 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.220403    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tznnh\"/\"openshift-service-ca.crt\""
Sep 15 09:56:47.221221 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.221206    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tznnh\"/\"default-dockercfg-7ll79\""
Sep 15 09:56:47.226349 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.226328    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tznnh/must-gather-6r8q9"]
Sep 15 09:56:47.243877 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.243840    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:56:47.270913 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.270886    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6vqs\" (UniqueName: \"kubernetes.io/projected/9dfb7828-de30-4673-a9fa-34d9d32f2c9b-kube-api-access-b6vqs\") pod \"must-gather-6r8q9\" (UID: \"9dfb7828-de30-4673-a9fa-34d9d32f2c9b\") " pod="openshift-must-gather-tznnh/must-gather-6r8q9"
Sep 15 09:56:47.271025 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.270923    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9dfb7828-de30-4673-a9fa-34d9d32f2c9b-must-gather-output\") pod \"must-gather-6r8q9\" (UID: \"9dfb7828-de30-4673-a9fa-34d9d32f2c9b\") " pod="openshift-must-gather-tznnh/must-gather-6r8q9"
Sep 15 09:56:47.343901 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.343874    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:56:47.371559 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.371532    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9dfb7828-de30-4673-a9fa-34d9d32f2c9b-must-gather-output\") pod \"must-gather-6r8q9\" (UID: \"9dfb7828-de30-4673-a9fa-34d9d32f2c9b\") " pod="openshift-must-gather-tznnh/must-gather-6r8q9"
Sep 15 09:56:47.371682 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.371615    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6vqs\" (UniqueName: \"kubernetes.io/projected/9dfb7828-de30-4673-a9fa-34d9d32f2c9b-kube-api-access-b6vqs\") pod \"must-gather-6r8q9\" (UID: \"9dfb7828-de30-4673-a9fa-34d9d32f2c9b\") " pod="openshift-must-gather-tznnh/must-gather-6r8q9"
Sep 15 09:56:47.371942 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.371920    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9dfb7828-de30-4673-a9fa-34d9d32f2c9b-must-gather-output\") pod \"must-gather-6r8q9\" (UID: \"9dfb7828-de30-4673-a9fa-34d9d32f2c9b\") " pod="openshift-must-gather-tznnh/must-gather-6r8q9"
Sep 15 09:56:47.382341 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.382312    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6vqs\" (UniqueName: \"kubernetes.io/projected/9dfb7828-de30-4673-a9fa-34d9d32f2c9b-kube-api-access-b6vqs\") pod \"must-gather-6r8q9\" (UID: \"9dfb7828-de30-4673-a9fa-34d9d32f2c9b\") " pod="openshift-must-gather-tznnh/must-gather-6r8q9"
Sep 15 09:56:47.526482 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.526393    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tznnh/must-gather-6r8q9"
Sep 15 09:56:47.826841 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.826737    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tznnh/must-gather-6r8q9"]
Sep 15 09:56:47.830565 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:56:47.830531    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9dfb7828_de30_4673_a9fa_34d9d32f2c9b.slice/crio-24161425b148d7ca439a56d83f0333e98728b681309f0c0e8f418a7586ce283a WatchSource:0}: Error finding container 24161425b148d7ca439a56d83f0333e98728b681309f0c0e8f418a7586ce283a: Status 404 returned error can't find the container with id 24161425b148d7ca439a56d83f0333e98728b681309f0c0e8f418a7586ce283a
Sep 15 09:56:47.832436 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:47.832416    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:56:48.838659 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:48.838569    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tznnh/must-gather-6r8q9" event={"ID":"9dfb7828-de30-4673-a9fa-34d9d32f2c9b","Type":"ContainerStarted","Data":"0e7f5a319ffe3e8b5e569351e36ce47024a83846caf3e3c525ad9f5933f4feb0"}
Sep 15 09:56:48.838659 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:48.838612    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tznnh/must-gather-6r8q9" event={"ID":"9dfb7828-de30-4673-a9fa-34d9d32f2c9b","Type":"ContainerStarted","Data":"3fcbb7151676d9eaeb1868d6af7b80dcd425f0a01e37c5be1352cc3c521f41f2"}
Sep 15 09:56:48.838659 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:48.838632    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tznnh/must-gather-6r8q9" event={"ID":"9dfb7828-de30-4673-a9fa-34d9d32f2c9b","Type":"ContainerStarted","Data":"24161425b148d7ca439a56d83f0333e98728b681309f0c0e8f418a7586ce283a"}
Sep 15 09:56:48.856184 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:48.856118    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tznnh/must-gather-6r8q9" podStartSLOduration=1.107224352 podStartE2EDuration="1.856096521s" totalImagesPullingTime="748.872169ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:56:48.853861475 +0000 UTC m=+2572.503277573" watchObservedRunningTime="2026-09-15 09:56:48.856096521 +0000 UTC m=+2572.505512614"
Sep 15 09:56:50.183281 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:50.183253    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rwg82_12d964ec-1ded-49e8-bd7c-18c450406339/global-pull-secret-syncer/0.log"
Sep 15 09:56:50.270904 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:50.270859    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log"
Sep 15 09:56:50.355110 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:50.355063    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-31.ec2.internal_3ff8a0f9e53340a35ae68e0eed981df6/haproxy/0.log"
Sep 15 09:56:54.564954 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:54.563828    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c4f5f6dd-krqn4_55afdde3-1232-4b3c-9cfc-da32d15b333b/authorino/0.log"
Sep 15 09:56:54.598839 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:54.596876    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-vdj8k_94c16614-2426-4abf-bf94-fb8ceedeba8c/manager/0.log"
Sep 15 09:56:54.703727 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:54.703689    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-6vvt7_f998df5e-f29e-49de-bff9-2519cfd61498/manager/0.log"
Sep 15 09:56:54.804930 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:54.804893    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-v4k4g_38567e1e-1f7e-4819-9f8c-f1d4d6de10ef/manager/0.log"
Sep 15 09:56:56.576117 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:56.576074    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-d7dcd_dbfb9779-5ab4-48b3-957f-7f0f503aa28e/cluster-monitoring-operator/0.log"
Sep 15 09:56:56.837199 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:56.837111    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pwtql_299003e7-bfed-45c2-9b2d-b61e3a4552a6/node-exporter/0.log"
Sep 15 09:56:56.871086 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:56.871040    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pwtql_299003e7-bfed-45c2-9b2d-b61e3a4552a6/kube-rbac-proxy/0.log"
Sep 15 09:56:56.898897 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:56:56.898865    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pwtql_299003e7-bfed-45c2-9b2d-b61e3a4552a6/init-textfile/0.log"
Sep 15 09:57:00.070451 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.070394    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/1.log"
Sep 15 09:57:00.081059 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.081028    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9m6q_19bd1cc7-62fa-4d3e-b603-90af4ec6d509/console-operator/2.log"
Sep 15 09:57:00.576925 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.576889    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"]
Sep 15 09:57:00.585304 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.585273    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:00.598297 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.598270    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"]
Sep 15 09:57:00.731567 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.731532    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84977075-3a8a-44d3-b650-ba1ec368424e-lib-modules\") pod \"perf-node-gather-daemonset-nkxtt\" (UID: \"84977075-3a8a-44d3-b650-ba1ec368424e\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:00.731788 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.731596    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84977075-3a8a-44d3-b650-ba1ec368424e-podres\") pod \"perf-node-gather-daemonset-nkxtt\" (UID: \"84977075-3a8a-44d3-b650-ba1ec368424e\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:00.731788 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.731717    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84977075-3a8a-44d3-b650-ba1ec368424e-proc\") pod \"perf-node-gather-daemonset-nkxtt\" (UID: \"84977075-3a8a-44d3-b650-ba1ec368424e\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:00.731929 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.731809    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzv56\" (UniqueName: \"kubernetes.io/projected/84977075-3a8a-44d3-b650-ba1ec368424e-kube-api-access-tzv56\") pod \"perf-node-gather-daemonset-nkxtt\" (UID: \"84977075-3a8a-44d3-b650-ba1ec368424e\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:00.731929 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.731862    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84977075-3a8a-44d3-b650-ba1ec368424e-sys\") pod \"perf-node-gather-daemonset-nkxtt\" (UID: \"84977075-3a8a-44d3-b650-ba1ec368424e\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:00.833285 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.833189    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84977075-3a8a-44d3-b650-ba1ec368424e-sys\") pod \"perf-node-gather-daemonset-nkxtt\" (UID: \"84977075-3a8a-44d3-b650-ba1ec368424e\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:00.833716 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.833591    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84977075-3a8a-44d3-b650-ba1ec368424e-sys\") pod \"perf-node-gather-daemonset-nkxtt\" (UID: \"84977075-3a8a-44d3-b650-ba1ec368424e\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:00.833939 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.833905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84977075-3a8a-44d3-b650-ba1ec368424e-lib-modules\") pod \"perf-node-gather-daemonset-nkxtt\" (UID: \"84977075-3a8a-44d3-b650-ba1ec368424e\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:00.834340 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.834207    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84977075-3a8a-44d3-b650-ba1ec368424e-lib-modules\") pod \"perf-node-gather-daemonset-nkxtt\" (UID: \"84977075-3a8a-44d3-b650-ba1ec368424e\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:00.834491 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.834302    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84977075-3a8a-44d3-b650-ba1ec368424e-podres\") pod \"perf-node-gather-daemonset-nkxtt\" (UID: \"84977075-3a8a-44d3-b650-ba1ec368424e\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:00.834845 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.834693    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84977075-3a8a-44d3-b650-ba1ec368424e-podres\") pod \"perf-node-gather-daemonset-nkxtt\" (UID: \"84977075-3a8a-44d3-b650-ba1ec368424e\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:00.835001 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.834808    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84977075-3a8a-44d3-b650-ba1ec368424e-proc\") pod \"perf-node-gather-daemonset-nkxtt\" (UID: \"84977075-3a8a-44d3-b650-ba1ec368424e\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:00.835278 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.835158    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84977075-3a8a-44d3-b650-ba1ec368424e-proc\") pod \"perf-node-gather-daemonset-nkxtt\" (UID: \"84977075-3a8a-44d3-b650-ba1ec368424e\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:00.835429 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.835410    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzv56\" (UniqueName: \"kubernetes.io/projected/84977075-3a8a-44d3-b650-ba1ec368424e-kube-api-access-tzv56\") pod \"perf-node-gather-daemonset-nkxtt\" (UID: \"84977075-3a8a-44d3-b650-ba1ec368424e\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:00.849735 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.849704    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzv56\" (UniqueName: \"kubernetes.io/projected/84977075-3a8a-44d3-b650-ba1ec368424e-kube-api-access-tzv56\") pod \"perf-node-gather-daemonset-nkxtt\" (UID: \"84977075-3a8a-44d3-b650-ba1ec368424e\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:00.899137 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:00.899096    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:01.190267 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:01.190223    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"]
Sep 15 09:57:01.196115 ip-10-0-136-31 kubenswrapper[2575]: W0915 09:57:01.195183    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod84977075_3a8a_44d3_b650_ba1ec368424e.slice/crio-8eafcdb6ed8379bb71ae10a94471237d99fb92325dc88d25f8427facafa2124f WatchSource:0}: Error finding container 8eafcdb6ed8379bb71ae10a94471237d99fb92325dc88d25f8427facafa2124f: Status 404 returned error can't find the container with id 8eafcdb6ed8379bb71ae10a94471237d99fb92325dc88d25f8427facafa2124f
Sep 15 09:57:01.449467 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:01.449388    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-6r9pn_8762be19-3c51-4ef7-8df4-ee06993466ad/volume-data-source-validator/0.log"
Sep 15 09:57:01.845657 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:01.845498    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8t8sv_e3d0ce8f-b1f2-44b6-9d10-c2d3f19deb08/konnectivity-agent/0.log" limit=1024
Sep 15 09:57:01.932593 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:01.932554    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt" event={"ID":"84977075-3a8a-44d3-b650-ba1ec368424e","Type":"ContainerStarted","Data":"6c0660e7b1e87ff24e89f9b3d3d64c8f78a7186c6c2a6915a63cbe840109abab"}
Sep 15 09:57:01.932923 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:01.932887    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt" event={"ID":"84977075-3a8a-44d3-b650-ba1ec368424e","Type":"ContainerStarted","Data":"8eafcdb6ed8379bb71ae10a94471237d99fb92325dc88d25f8427facafa2124f"}
Sep 15 09:57:01.933487 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:01.933458    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:01.953981 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:01.953908    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt" podStartSLOduration=1.953883426 podStartE2EDuration="1.953883426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:57:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:57:01.950972288 +0000 UTC m=+2585.600388383" watchObservedRunningTime="2026-09-15 09:57:01.953883426 +0000 UTC m=+2585.603299521"
Sep 15 09:57:02.659734 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:02.659704    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zntgf_067feeac-5425-4c11-b58a-5d2f8cf37015/dns/0.log"
Sep 15 09:57:02.679394 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:02.679361    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zntgf_067feeac-5425-4c11-b58a-5d2f8cf37015/kube-rbac-proxy/0.log"
Sep 15 09:57:02.753384 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:02.753354    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8fznm_06f3e00e-6b02-4341-af4c-3228fdb5f592/dns-node-resolver/0.log"
Sep 15 09:57:03.343152 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:03.343125    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hgkhw_f3ac0b66-da35-4fc2-964a-e6583ff9a29f/node-ca/0.log"
Sep 15 09:57:04.856993 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:04.856959    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6df85cfc68-4l796_d7a7c868-50a9-4e91-906c-0884d05de98e/kube-auth-proxy/0.log"
Sep 15 09:57:04.962419 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:04.962389    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-szd7z_64ea1d0e-c8c9-4b1f-babe-11a283e0538e/payload-pre-processing/0.log"
Sep 15 09:57:05.001559 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:05.001530    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pljbs_9fcbe6bc-94d4-4557-bb35-1e664c775fa0/payload-processing/0.log"
Sep 15 09:57:05.028817 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:05.028730    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5995ff59fb-4rbww_49237773-7a17-4886-b757-650adf21b082/router/0.log"
Sep 15 09:57:06.015114 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:06.015072    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d44h8_15eafc79-a1c2-4649-93d1-8fcc4297f3b6/serve-healthcheck-canary/0.log"
Sep 15 09:57:06.525438 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:06.525398    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-2wvs2_00e2f7b7-6323-4c32-abe4-5405e244cf0c/insights-operator/0.log"
Sep 15 09:57:06.525823 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:06.525808    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-2wvs2_00e2f7b7-6323-4c32-abe4-5405e244cf0c/insights-operator/1.log"
Sep 15 09:57:06.645098 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:06.645060    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wqxxs_f6b9f3cc-cc0e-4150-9353-6dd6f77afe88/kube-rbac-proxy/0.log"
Sep 15 09:57:06.670842 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:06.670815    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wqxxs_f6b9f3cc-cc0e-4150-9353-6dd6f77afe88/exporter/0.log"
Sep 15 09:57:06.698681 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:06.698652    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wqxxs_f6b9f3cc-cc0e-4150-9353-6dd6f77afe88/extractor/0.log"
Sep 15 09:57:07.949134 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:07.949105    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-nkxtt"
Sep 15 09:57:08.955591 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:08.955561    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7trbv_2d5bfe75-40dc-4f94-8fb7-d6ce5327fcac/manager/0.log"
Sep 15 09:57:09.308181 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:09.308152    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xgr86_431f5053-0f35-4cb5-920f-848f2a7d9292/manager/0.log"
Sep 15 09:57:09.363197 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:09.363167    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d5f7f7fc6-64m6z_7b43e136-b50a-4256-aa38-21d88f6dbec0/manager/0.log"
Sep 15 09:57:09.669986 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:09.669959    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-767c4c8b76-spbm4_4dd31bb8-7087-4944-a536-f8354456be9d/manager/0.log"
Sep 15 09:57:09.696581 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:09.696556    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-767c4c8b76-spbm4_4dd31bb8-7087-4944-a536-f8354456be9d/copy-manifests/0.log"
Sep 15 09:57:11.510174 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:11.510145    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6df85cfc68-4l796_d7a7c868-50a9-4e91-906c-0884d05de98e/kube-auth-proxy/0.log"
Sep 15 09:57:11.573486 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:11.573442    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-szd7z_64ea1d0e-c8c9-4b1f-babe-11a283e0538e/payload-pre-processing/0.log"
Sep 15 09:57:11.597080 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:11.597050    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pljbs_9fcbe6bc-94d4-4557-bb35-1e664c775fa0/payload-processing/0.log"
Sep 15 09:57:11.613387 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:11.613341    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5995ff59fb-4rbww_49237773-7a17-4886-b757-650adf21b082/router/0.log"
Sep 15 09:57:13.558866 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:13.558839    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6df85cfc68-4l796_d7a7c868-50a9-4e91-906c-0884d05de98e/kube-auth-proxy/0.log"
Sep 15 09:57:13.625866 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:13.625833    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-szd7z_64ea1d0e-c8c9-4b1f-babe-11a283e0538e/payload-pre-processing/0.log"
Sep 15 09:57:13.653587 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:13.653559    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pljbs_9fcbe6bc-94d4-4557-bb35-1e664c775fa0/payload-processing/0.log"
Sep 15 09:57:13.673302 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:13.673276    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5995ff59fb-4rbww_49237773-7a17-4886-b757-650adf21b082/router/0.log"
Sep 15 09:57:16.550163 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:16.550136    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-xz7jg_94c76993-536e-4925-990b-8244b58c8879/kube-storage-version-migrator-operator/1.log"
Sep 15 09:57:16.551319 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:16.551300    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-xz7jg_94c76993-536e-4925-990b-8244b58c8879/kube-storage-version-migrator-operator/0.log"
Sep 15 09:57:17.809782 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:17.809698    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nx8dj_6272a978-5c5f-452a-88c0-91affa1d942c/kube-multus-additional-cni-plugins/0.log"
Sep 15 09:57:17.836828 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:17.836802    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nx8dj_6272a978-5c5f-452a-88c0-91affa1d942c/egress-router-binary-copy/0.log"
Sep 15 09:57:17.860560 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:17.860535    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nx8dj_6272a978-5c5f-452a-88c0-91affa1d942c/cni-plugins/0.log"
Sep 15 09:57:17.882845 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:17.882818    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nx8dj_6272a978-5c5f-452a-88c0-91affa1d942c/bond-cni-plugin/0.log"
Sep 15 09:57:17.905043 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:17.905008    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nx8dj_6272a978-5c5f-452a-88c0-91affa1d942c/routeoverride-cni/0.log"
Sep 15 09:57:17.929339 ip-10-0-136-31 kubenswrapper[2575]: I0915 09:57:17.929320    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nx8dj_6272a978-5c5f-452a-88c0-91affa1d942c/whereabouts-cni-bincopy/0.log"